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ABSTRACT 

Paclcet  Radio  is  a  digital  communications  concept  which 
offers  the  user  the  capability  to  pass  voice  and  other  data 
traffic  in  a  radio  network  which  may  link  high  power 
computers  with  small  mobile  radios  containing 
microprocessors.  The  technique  of  routing  digital  traffic 
from  source  to  destination  depends  on  the  operational 
requirements  of  the  network.  Most  routing  concepts  today 
centralize  network  control  (in  varying  degrees)  for  normal 
operations.  This  thesis  describes  a  concept  for  completely 
decentralized  control  of  a  packet  radio  network.  The  basic 
protocol  is  relatively  simple  and  robust,  but  suffers  from 
the  usual  build-up  of  overhead  traffic  with  network  size. 
Another  related  routing  protocol  is  proposed  which,  under 
certain  operational  situations,  reduces  routing  traffic  and 
memory  requirements  compared  to  the  basic  algorithm.  A 
concept  for  use  cf  alternate  links  in  the  event  of  a  broken 
link  is  also  suggested. 
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I.   INTRODJCTION 

A.   TH2  PACKET  RADIO  CONCEPT 

Packet  Radio  technology  extends  the  application  of 
packet  switching  into  the  mobile  radio  environment.  It 
offers  a  convenient  and  efficient  way  to  communicate  among  a 
large  number  of  mobile  users.  This  is  particularly 
important  in  a  tactical  environment  where  rapid  deployment 
and  mobility  are  required. 

asers  in  a  packet  radio  network  essentially  share  common 
radio  channels.  Use  of  these  channels  is  (to  varying 
degrees)  controlled  by  microprocessors  in  the  user's  radio 
in  a  manner  which  is  transparent  to  the  user.  Packet  Radio 
is  a  digital  communications  concept  which  in  principle  can 
accommodate  voice  as  well  as  digital  data  traffic  provided 
that  adequate  traffic  capacity  is  available.  The  use  in 
packet  radio  of  spread  spectrum  communications  is 
particularly  attractive  to  military  applications  because  of 
potential  capabilities  for  a  low  probability  of  intercept 
(LPI)  and  excellent  antijamming  (AJ)  characteristics. 

Although  the  military  is  pressing  development  in  packet 
radio  technology,  it  is  also,  in  a  sense,  part  of  the 
natural  evolution  of  the  computer  age.    Almost  all  computer 


networks  are  bound  to  the  cables  which  connect  the 
computers.  Yet  as  computers  get  smaller  and  potentially 
more  mobile,  the  need  for  wireless  links  become  more 
important. 

Two  packet  radio  network  testbeds  are  currently  in 
operation.  The  Bay  Area  PRNET  (packet  radio  network)  in  San 
Francisco  has  been  operational  since  1976,  and  is  the 
primary  site  for  development  and  evaluation  of  network 
protocols  and  application  concepts.  The  Army  Data 
Distribution  System  (ADDS)  testbed  PfiNET  at  Ft.  Bragg,  North 
Carolina,  became  operational  in  1979  with  the  objectives  of 
providing  potential  users  of  packet  radio  technology  with 
exposure  to  the  technology  early  in  its  development,  giving 
timely  feedback  to  developers  and  offering  the  users  an 
opportunity  to  experimentally  determine  the  impact  on 
tactical  doctrine  of  mobile  access  to  computer-based  command 
and  control. 

B.   ROUTING 

The  goal  of  a  properly  operating  packet  radio  network  is 
to  route  packets  (groups  of  bits)  thru  a  series  of  radios 
from  the  sender  to  the  receiver  in  an  efficient  manner. 
2nroute,  the  packet  is  automatically  processed  and  passed  on 
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by  a  series  of  radios  in  a  manner  transparent  to  those 
users.  Through  multiplexing  or  other  concepts,  a  radio  may 
provide  input/ouxput  service  to  its  user  and  also  forward 
other  traffic  simutaneously .  Because  of  the  limited  power 
of  mobile  radios,  a  transmitter  may  often  not  have  a  direct 
link  with  the  ultimate  receiver.  In  a  military  application, 
low  power  transmissions  may  also  enhance  survivability. 
Therefore  the  routing  from  every  potential  message  source  to 
every  potential  destination  requires  the  application  of  a 
network-wide  intelligence  to  determine  the  most  efficient 
links  along  which  to  forward  the  message.  There  are  two 
main,  different  approaches  to  routing  algorithms  for  solving 
this  problem. 

1  .   Centralized  and  Backbone  Systems 

Both  the  Bay  Area  PRNET  and  the  Ft.  Bragg  PRNET  use 
network  components  called  stations  to  manage  the  routing  in 
different  portions  of  the  network.  In  the  Ft.  Bragg 
network,  each  station  is  a  (DEC)  PDP  11/UO.  The  purpose  of 
the  station  is  to  monitor  the  relative  activity  level  in 
each  radio  under  its  jurisdiction,  and  to  aid  in  the  routing 
of  traffic  that  passes  thru.,  originates  or  terminates  in  its 
portion  of  the  network. 
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There  may  be  many  stations  in  a  network,  each 
controlling  a  certain  number  of  user  radios.  Together  tney 
provide  the  network-wide  intelligence  which  maintains  and 
implements  the  dynamic  routing  scenerio.  Network  control  is 
centralized  in  the  stations-  This  scheme  is  both  practical 
and  efficient.  However  in  a  military  sense,  stations-  are  a 
vulnerability  since  only  a  few  of  them  control  the  operation 
of  all  the  radios  in  the  network. 

Use  of  a  backbone  network  offers  similar  advantages 
and  shortcomings.  A  backbone  is  a  network  superimposed  over 
a  common  user  network  whic^  improves  the  efficiency  of  the 
network  by  providing  high  volume,  high  speed  and/or  long 
distance  trunks.  Traffic  from  rhe  common  user  is  placed  on 
and  taken  off  of  the  backbone  in  accordance  with  a  routing 
process  such  as  the  station  concept  mentioned  above.  Once 
again,  the  vulnerability  of  the  network  is  directly  related 
to  the  vulnerability  of  the  backbone. 

2 .   Completely  Decentralized  Routing 

A  completely  decentralized  network  does  not  have 
stations  or  a  backbone.  Conceivably,  every  user  has  a 
packet  radio  containing  a  microprocessor  which  is  no 
different  than  any  other  communications/processing  component 
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(other  packet  radios)  in  the  network.  Depending  on  the 
topographical  situation,  there  may  also  be  unattended  packet 
radios  in  the  network.  These  radios  do  not  have  users  which 
use  the  radio  as  a  terminal  into  and  out  of  the  network. 
They  are  usually  placed  in  positions  in  the  network  ro 
provide  additional  communication  paths  or  links  increasing 
the  number  of  routing  alternatives.  However  these 
unattended  radios  function  essentially  the  same  as  a 
terminal  user's  radio  insofar  as  message  processing  is 
concerned.  In  ether  words,  in  a  decentralized  network, 
every  radio  is  the  same  and  there  is  no  centralized  or 
semi-centralized  component  controlling  how  the  network 
operates.  It  is  the  collection  of  packet  radios  themselves 
which  must  combine  their  processing  capabilities  to  create 
the  network-wide  intelligence  needed  to  build,  maintain  and 
implement  an  efficient  routing  scheme  for  user  traffic.  The 
advantage  is  a  reduction  in  the  vulnerabilities  inherent  in 
any  system  which  tends  to  centralize  its  control 
capabilities.  The  disadvantages  are  increased  complexity, 
increased  overhead  traffic  (which  represents  competition 
with  user  traffic  for  a  finite  channel  capacity) ,  and 
possibly  a  reduction  in  speed. 
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Th9  cbj€ctiv€  of  this  study  is  to  present  and 
investigate  the  performance  of  a  simple  algoritiini  vhica 
could  be  programmed  into  each  packet  radio  in  a  completely 
decentralized  network.  Assuming  that  each  radio  in  the 
network  has  a  very  limited  range  compared  to  rhe  diameter  of 
the  network,  the  algorithm  allows  each  radio  to  relay 
information  about  other  radios  (called  nodes  from  now  on) 
throughout  the  network.  The  algorithm  uses  this 
information,  as  it  works  its  way  through  the  network,  to 
create  relatively  efficient  communication  paths  (links) 
between  every  pair  of  radios  (nodes)  in  the  network.  The 
end  result  automatically  gives  users  throughout  rhe  network 
the  appearance  of  direct  dccess  to  every  other  node  in  the 
network,  albeit  with  some  delay.  The  dynamic  routing  of 
traffic  as  it  is  created  and  enters  the  network  enables  many 
channels  of  communications  to  exist  simutaneously  across  the 
network. 
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II.   NETWORK  aODELING 

Although  this  study  is  based  on  what  is  considered  a 
practical  concept  for  a  military  radio  network,  the  theory 
can  be  considered  very  general  in  nature.  Therefore,  the 
network  is  modeled  as  a  combination  of  nodes  and  linJcs 
between  nodes.  Furthermore,  the  nodes  and  links  are 
affected  dynamically  by  events  such  as  routine  traffic,  the 
gain  or  loss  of  a  link,  and  network  maintenance  traffic. 
This  chapter  defines  the  modeling  components  and  functions, 
relates  them  to  physical  components  or  requirements,  and 
makes  some  assumptions. 

A.   NODES 

In  the  model,  nodes  represent  receiver-transmitters. 
Nodes  also  contain  processors.  It  is  convenient  to  picture 
many  functions  in  each  node  performed  by  parallel  processors 
so  that  all  unrelated  processing  can  be  performed 
simutaneously.  Conversely,  only  those  operations  which  must 
be  performed  in  a  sequence  with  a  significant  execution  time 
are  subject  to  conflicts  and  queuing  delays. 

All  nodes  in  the  network  have  exactly  the  same 
capabilities.     However,    depending   on   its   processing 
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instructions,  each  node  may  process  a  given  message 
differently.  Per  exaiiiple,  one  node  may  be  a  terminal  for  a 
specific  aser.  Therefore,  this  node  may  accept  routine 
traffic  for  a  certain  list  of  addresses,  determine  wnich 
traffic  is  addressed  to  its  assigned  user,  deliver  that 
traffic,  and  retransmit  the  remainder  to  the  appropriate 
addresses.  Another  node  may  be  solely  a  transmitter  which 
only  relays  routine  traffic  and  does  not  serve  as  a  terminal 
for  a  user. 

When  one  node  can  pass  traffic  directly  to  another  node, 
the  other  node  is  considered  a  neighbor  to  the  first  node. 
These  nodes  are  connected  by  a  link.  Although  every  node  in 
our  network  can  contact  every  other  node,  each  node  has  only 
a  liaited  list  of  neighbors  which  may  vary  with  time. 

3.   LINKS 

A  link  exists  whenever  two  nodes  are  in  direct  contact 
with  each  other.  A  link  is  considered  broken  when  one  or 
both  nodes  lose  the  capability  to  transmit  to,  or  receive 
from,  the  other  node.  Therefore,  a  link  implies  two-way 
communications  between  specific  node  pairs.  Of  course  the 
actual  method  of  communications  in  a  radio  network  is 
through   antenna   transmissions.     These   may    be   either 
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directional  or  omni-directional  antennas.  And  of  course, 
these  transmissions  could  poxentially  be  received  by  many 
nodes  other  than  a  particular  partner  in  a  node  pair. 
Conceptually,  this  can  be  accommodated  by  assuming  that  all 
traffic/packets  contain  the  address  of  the  intended 
receiving  node  for  a  given  link.  Then  any  node  which 
receives  traffic  not  addressed  to  it  simply  ignores  the 
message. 

Another  more  sophisticated  concept  has  a  link 
representing  a  unique  center  frequency  which  one  node  uses 
to  transmit  to  another.  In  creating  the  link,  the  two  nodes 
determine  which  frequency  bands  are  mutually  available,  and 
then  each  selects  an  available  transmission  frequency  to 
communicate  with  the  other  node.  Now,  when  either  node 
wishes  to  transmit  to  the  other,  it  uses  its  selected 
frequency  band.  Conceptually,  only  one  node  within  range  of 
a  given  transmitter  will  accept  traffic  in  a  particular 
frequency  band.  In  this  manner  more  than  one  link  to  a 
single  node  may  be  operating  simutaneously.  Other  more 
familiar  techniques  such  as  Code  Division  Multiplexing  could 
also  be  used  to  establish  a  link. 
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C.   CHANNEL  VALUE 

Assuming  that  a  network  consisting  of  aany  links  has 
been  established,  one  needs  an  efficient  way  to  use  this 
network.  Clearly,  an  unacceptable  technique  would  be  to 
retransmit  every  message  on  every  link  to  ensure  that  the 
addressee  receives  the  message.  Although  it  may  ensure  chat 
a  single  message  gets  to  its  destination,  it  represents  work 
for  every  node  in  the  network.  Assuming  that  different 
messages  could  be  initiated  by  many  nodes  in  the  network, 
and  that  much  cf  this  traffic  could  be  present  in  the 
network  at  the  same  time.  The  inefficiencies  of 
broadcasting  quickly  lead  to  saturating  nodes  or  links  in 
the  network,  since  nodes  indiscriminanrly  relay  everything 
they  hear.   Smart  nodes  should  be  able  to  do  much  better. 

What  is  needed  is  a  way  of  selecting  one  link  over 
another  link.  Once  that  decision  is  made,  traffic  for  a 
given  destination  uses  only  the  best  path,  or  optimum 
series  of  links,  from  the  source  of  a  message  to  its 
destination.  One  way  to  quantify  the  connection  between  two 
nodes  is  to  assign  a  weight  or  cost  value  to  each  link  or 
channel  in  the  network.  Then,  summing  the  costs  for  a  given 
path  between  two  nodes,    one  can  assign  a  value  to  every 
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possible  path,   and  thereby  (theoretically)   picJc  the  lowest 
cost  path  between  a  source  and  destination. 

There  may  be  many  ways  to  assign  channel  values.  One 
practical  technique  would  be  to  count  the  backlog  or  traffic 
(or  packets)  waiting  to  use  a  particular  link.  This  queue 
or  delay  represents  a  portipn  of  xhe  total  time  it  takes  for 
a  message  to  reach  its  destination.  Normally  it  is  desired 
that  traffic  move  through  the  network  as  quickly  as 
possible.  This  is  particularly  important  if  the  network  is 
to  accommodate  real-time  speech.  Therefore,  a  channel  value 
which  reflects  net  transmission  time  is  useful.  This  is  the 
technique  used  in  this  study. 

D.   NETWORK  DYNAillCS 

Nodes  and  links  represent  the  static  network  structure. 
But  a  practical  network  must  accommodate  changes  which  may 
be  represented  as  the  creation  or  destruction  of  nodes  or 
links.  Furthermore,  there  must  be  a  concept  for  passing 
network  maintenance  information  and,  most  importantly,  user 
traffic. 

1 .   Routine  or  User  Traffic 

A  network  exists  to  pass  routine  traffic.    Traffic 
could   be   either   inter-active   voice    (characterized   by 
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real-time  conversations) ,  or  data  (characterized  by  one-tfay 
transmissions  assembled  or  stored  at  the  receiving  end  for 
later   review)  . 

In  a  digital  network,  both  voice  and  data  traffic 
are  transmitted  in  the  form  of  digital  packets.  For  voice 
traffic,  the  most  important  zhing  is  that  packets  arrive  at 
a  relatively  uniform  rate.  Voice  packets  are  created  by 
sampling  the  voice  signal.  The  number  of  voice  bits 
reguired  per  unit  time  is  a  function  of  the  encoding 
technique  and  the  desired  quality  of  the  received  signal. 
Any  additional  bits  are  unnecessary  and  therefore  waste 
channel  capacity.  Fewer  bits,  in  the  form  of  delayed  or 
lost  voice  packets,  may  degrade  the  reception.  Note  that 
once  a  voice  packet  is  delayed  one  inter-packet  period, it  is 
no   longer    useful. 

For  data  traffic,  it  is  not  necessary  to  have  a 
smooth  flow  of  traffic.  Bursty  traffic  is  quite  acceptable. 
The  important  thing  is  that  after  the  message  is  divided 
into  packets  for  transmission  from  the  source  node,  all 
these  packets  are  recovered  and  reassembled  properly  at  the 
destination   node   to   recreate  the   original  message. 
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The  ability  for  data  packets  to  move  satisfactorily 
in  a  bursty  maDner  allows  them  to  complement  the  rigid 
schedule  of  voice  packets.  A  concept  tor  the  integration  of 
voice  and  data  traffic  is  discussed  in  more  detail  in 
Chapter  III. 

2.   Broken  Links 

As  defined  earlier,,  a  link  implies  the  capability 
for  two-way  communications  J:etween  two  nodes.  A  broken  link 
is  recognized  in  a  node  when  it  is  discovered  that  this 
two-way  capability  no  longer  exists.  Depending  on  the 
situation,  as  explained  in  Chapter  III,  the  two  nodes  on 
each  side  of  a  link  may  realize  a  link  is  broken  at 
different  times. 

In  modeling  a  network,  a  broken  link  may  be  used  t:o 
represent  various  events.  If  a  node  is  lost,  it  could  be 
reflected  as  a  broken  link  between  the  lost  node  and  each  of 
its  neighbors.  If  the  transmission  path  between  neighbors 
is  interrupted,  this  can  be  represented  as  a  loss  of  a 
single  link  between  the  two  nodes.  If  links  are  broken  in  a 
particular  pattern,  it  may  indicate  that  a  parxicular  node 
is  moving  away  from  its  neighbors. 
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3.  New  Links 

As  opposed  to  a  broken  link,  a  new  link  is  created 
when  the  nodes  on  each  end  establish  communication  with  each 
other.  This  will  typically  require  some  interaction  between 
the  two  nodes. 

New  links  would  be  created  when  an  inactive  node 
becomes  active,  when  a  moving  node  moves  into  range  of  other 
nodes,  or  when  other  conditions  change  to  enable  two-way 
communications  between  two  nodes  where  conditions  previously 
prevented  this  link. 

It  is  apparent  that  a  network  can  be  dynamically 
modeled  by  allowing  links  to  be  broken  or  created  to 
represent  physical  activities  such  as  changing  signal  paths, 
nodes  entering  and  leaving  the  network  (being  turned  on  or 
off) ,  node  movements  and  other  situations, 

4 .  Network  Maintenance  Traffic 

If  the  nodes  in  a  network  are  to  be  as  organized  and 
resourceful  as  described  above,  then  they  must  be  programmed 
to  communicate  with  each  other,  passing  information  related 
to  their  activity  and  capabilities.  In  a  network  with  fully 
distributed  control,  the  objective  is  to  achieve  efficient 
network-wide  communication   under  the   constraint  that  each 
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node  can  only  transmit  and  receive  directly  with  a  limited 
number  of  neighbors.  There  is  no  central  control  facility 
to  route  and  monitor  traffic  between  non-adjacent  nodes. 

Every  user  in  the  network  must  be  able  to  reach 
every  other  user  in  the  network  in  a  manner  wnich  is 
transparent  to  all  users,  even  in  a  dynamic  environment 
where  links  are  created  or  broken  randomly.  Therefore,  over 
and  above  user  traffic,  nodes  must  pass  network  maintenance 
traffic.  This  traffic  should  be  transparent  to  the  user. 
This  means  that  the  nodes  measure  or  sense  their  operational 
status  and  are  programmed  to  automatically  report 
information  to  their  neighbors.  Neighbors  process  the 
information  and  may  then  automatically  relay  the  processed 
information  to  selected  neighbors  until  every  node  reguiring 
the  information  eventually  receives  it.  A  program  or 
algorithm  that  generates  and  processes  network  maintenance 
traffic  is  commonly  called  a  protocol.  At  a  minimum,  to 
model  a  practical  network,  network  maintenance  traffic  must 
accommodate  new  links,  broken  links,  and  changes  in  channel 
values  which  may  represent  more  efficient  ways  of  routing 
routine  traffic  through  the  network.  The  concept  of 
protocols  for  distributed  networks  is  discussed  in  much 
greater  detail  in  Chapter  III. 
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III.   LEVELS  OF  DISTRIBUTED  PROTOCOL 

A  distributed  protocol  in  a  packet  radio  network  is 
defined  as  algorithms  which  are  executed  independently  in 
each  node  to  process  both  network  maintenance  and  routine 
traffic.  The  effect  should  be  the  overall  efficient  use  of 
network  resources,  approaching  the  efficiency  of  a  centrally 
controlled  network. 

A  particular  protocol  may  be  based  on  many  design 
considerations.  Of  course  the  designer  must  consider  the 
capabilities  of  available  or  proposed  equipment  and  the 
characteristics  of  the  operating  medium.  But  within  these 
constraints,  the  designer  may  be  free  to  trade  off  such 
things  as  simplicity  and  robustness  for  speed  and 
sophistication.  And  of  course  these  qualities  are  nor 
mutually  exclusive.  Therefore,  rhe  examples  of  distributed 
protocols  in  the  literature  vary  from  rather  limited,  simple 
ones  such  as  Yen's  algorithm  [Ref.  1],  to  more 
sophisticated  and  complicated  algorithms  such  as 
Segall's  [Ref.  2]. 

It  may  be  helpful  to  break  down  network  operations 
performed  by  each  node  into  three  groups  or  levels  of 
protocol.     In   this   way  activities   can   be   isolated. 
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controlled  and  analyzed  in  a  modular  fashion  while  assuming 
the  remainder  of  the  node's  functions  are  unaffected  and 
operating  as  expected.  This  study  assumes  three  levels  of 
protocol.  The  first  is  node  to  node  protocol,  the  second  is 
networlc  management  protocol  and  the  third  is  user  service 
protocol.  Concepts  and  examples  of  node  to  node  protocol 
and  user  service  protocol  are  discussed  in  some  detail  in 
this  chapter.  Network  management  protocol  is  mentioned  only 
briefly  in  this  chapter.  However,  a  detailed  concept  and 
example  is  developed  and  analyzed  in  the  remainder  of  this 
study. 

A.       NODE  TO  NODE  PROTOCOL 

There  are  several  activities  required  in  an  active 
networic  which  basically  involve  only  two  nodes.  Perhaps  the 
most  fundamental  interaction  is  recognizing  each  other. 
This  mutual  recognition  is  considered  a  link.  Links  exist 
to  pass  traffic,  which  leads  to  another  important 
inter-nodal  function,  that  of  the  receiving  node  informing 
the  sending  node  that  it  has  received  its  message. 

1 .   Establishing  and  Monitoring  a  Link 

A   node   to  node   protocol   should    provide   for 
establishing  communications  between  two   nodes.    This  could 
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be  accomplished  by  each  node  asynchronously  transmitting  a 
beacon  message  on  a  designated  frequency.  The  beacon 
message  would  contain  the  identity  of  its  originator.  Any 
other  node  receiving  the  beacon  message  with  an  adequate  S/N 
ratio  checks  its  list  of  neighbors.  If  the  node  addressed 
in  the  beacon  message  is  not  found  on  the  receiving  node's 
neighbor  list,  the  receiving  node  would  initiate  an 
acknowledgement  message  addressed  to  the  node  which  sent  the 
beacon  message.  If  the  original  node  now  receives  the 
acknowledgement,  it  adds  the  node  which  sent  the 
acknowledgement  message  to  its  neighbor  list  and  sends  that 
node  a  notice  message  that  two  way  communications  exist. 
Finally,  the  node  which  initially  responded  to  the  beacon 
message  adds  the  originator  of  the  beacon  messageto  its 
neighbor  list  and  a  new  link  is  born. 

As  mentioned  in  Chapter  II,  the  implementation  of  a 
link  may  vary  by  design.  If,  for  example,  the  two  way  link 
actually  consists  of  two  frequency  bands  which  enable 
simultaneous  transmission  between  two  nodes  on  a  single 
link,  then  the  interchange  of  information  in  establishing 
the  link  would  include  the  determination  of  mutually 
available  frequency   bands.    If,   on   the  other   hand,   the 


26 


network  used  Carrier  Sense  Multiple  kccess  (CSMA) ,  which  was 
the  technique  actually  used  in  the  DAfiPA  packet  radio 
testbed  which  operated  in  the  San  Francisco  Bay 
area  [Ref.  3],  then  different  information  must  be  passed  to 
establish  a  link. 

Once  established,  the  status  of  a  link  must  be 
monitored.  The  beacon  message  could  also  be  used  for  this 
function.  A  node  should  expect  to  receive  beacon  messages 
from  every  node  on  its  neighbor  list.  Therefore,  when  ir 
receives  the  beacon  message  there  is  no  need  to  reply. 
However,  it  may  note  the  time  it  received  the  lasz  beacon 
message  from  each  of  its  neighbors.  Failing  to  receive  a 
beacon  jnessage  from  a  neighbor  over  an  established  period  of 
time  would  prompt  a  node  to  conclude  that  it  had  lost  two 
way  communications.  This  may  have  an  impact  on  many  other 
nodes  in  the  network  and  would  therefore  initiate  a  reaction 
by  the  Network  management  protocol  as  discussed  in  paragraph 
2  below.  When  a  node  discovers  it  has  lost  a  link,  the 
corresponding  node  on  the  other  end  of  the  link  must  be 
removed  from  its  list  of  neighbors. 

There  is  another  more  immediate  way  for  a  node  to 
discover  that  it  has  lost  a  link.    This  would  occur  when  a 
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node  attempted  to  send  a  packet  to  a  neighboring  node  but 
does  not  receive  an  appropriate  acknowledgement  for  a 
successful  transmission.  If  this  is  the  case,  the  sending 
node  could  try  to  retransmit  at  least  one  more  time,  but 
eventually  it  may  conclude  that  the  link  has  been  broken. 
Once  again  this  may  initiate  activity  by  a  higher  level 
protocol.  This  also  demonstrates  how  one  node  may  discover 
that  a  link  has  been  broken  before  it  is  discovered  by  its 
corresponding  neighbor.  In  any  packet  radio  concept,  ihe 
establishment  and  monitoring  of  links  is  a  fundamental 
activity  that  can  be  delegated  to  a  low  level  protocol, 
2.  *  Packet  Acknowledgement 

Another  node  to  node  function  is  the  acknowledgement 
by  the  receiving  node  to  the  sending  node  that  a  packet  has 
been  successfully  transmitted  across  a  link.  Under  any 
practical  operating  concept  for  a  packet  radio  network, 
there  are  significant  opportunities  for  a  node  to  improperly 
receive  a  packet.  A  few  of  these  situations  include 
multipath  interference,  intentional  or  unintentional 
jamming,  fading  or  improper  synchronization.  A  conservative 
design  consideration  would  preclude  a  transmitting  node  from 
purging  a  transmitted  packet  from  its  memory  until  it  has 
received  acknowledgement  that  the  packet  has  been  receivsd. 
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In  the  ALOHA  net,  operated  by  the  University  of 
Hawaii,  this  acknowledgement  is  accomplished  as  the  sending 
node  monitors  the  retransmission  of  the  receiving  node.  If 
the  retransmission  matches  what  was  sent,  the  sending  node 
eliminates  the  packet  from  its  memory.  If  it  did  not,  rhe 
packet  is  resent.  This  is  an  adequate  technique  for  an 
ALOHA-type     network.  But     if        a     node        uses     different 

frequencies  for  each  link,  this  technique  may  be 
impractical. 

Another  concept  is  ro  terminate  each  packet  with 
check  bits.  The  number  of  check  bits  per  packet  would  be  a 
function  of  the  expected  probability  of  error  per  bit  for  an 
average  link.  If  all  check  bits  are  properly  received,  the 
receiving  node  reports  its  successful  reception  to  -^he 
sending  node  in  a  brief  message.  Lack  of  such  a  report 
after  an  established  period  of  time  may  prompt  a  node  to 
retransmit  a  packet.  Receipt  of  an  acknowledgement  would 
cause  a  node  to  eliminate  the  packet  from  its  memory, 
considering  it  successfully  transmitted.  There  are  check 
bit  schemes  for  fail-safe  communications  which  are  not  only 
more  efficient  than  a  bit-for-bit  check,  but  are  also  more 
reliable  [Ref .    4], 
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other  verification  concepts  may  offer  still  other 
advantages.  However,  because  of  the  inherent  potential  and 
significant  effects  if  bit  error  in  radio  communications,  it 
is  very  likely  that  some  technique  of  ensuring  accurate 
packet  transmission  will  be  required  in  any  packet  radio 
network. 

3.   NETWORK  MANAGEMENT  PROTOCOL 

The  primary  objective  of  a  communications  network  is  to 
move  user  traffic  from  source  to  destination.  A  network 
management  protocol  is  intended  to  organize  the  network  so 
that  traffic  moves  efficiently  under  all  conditions. 

If  one  assumes  that  node  to  node  activities  are 
appropriately  handled  by  a  lower  level  protocol  as  described 
above,  rhen  he  can  treat  the  loss  or  addition  of  anotiaer 
link  as  a  routine  event,  and  process  the  information  as  it 
would  affeci:  the  entire  network.  Therefore,  network 
management  protocol  is  not  concerned  with  hew  or  under  what 
conditions  a  link  is  established.  It  only  acts  on  the 
information  that  a  link  does  or  does  not  exist. 

1 .   gpdate 

The  fundamental  network-wide  management  operation  is 
the   update.      In   an   operational   network,    traffic    on   each   link 
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is  constantly  changing.  To  efficiently  use  the  network  to 
pass  traffic  between  two  given  nodes,  it  is  desirable  to 
find  the  "Best  Path"  between  the  two  nodes.  Exactly  what  is 
leasured  may  be  a  subjective  decision.  But  once  made,  this 
quantity  can  be  used  to  compare  various  alternatives  and 
select  a  best  path.  Yet  the  best  path  can  be  expected  to 
vary  with  time,  for  loading  on  each  link  of  a  network  may  be 
constantly  changing.  Therefore  best  paths  must  be  updated 
periodically  to  accommodare  network  dynamics. 

In  a  distributed  control  network,  each  node  could 
initiate  its  own  update.  The  form  of  this  update  message 
and  exactly  how  it  is  processed  in  the  network  depends  on 
the  selected  protocol.  There  is  always  a  design  trade-off 
involving  the  frequency  of  updates  with  the  corresponding 
generation  of  update  messages  (management  traffic)  versus 
the  effects  of  old  or  outdated  best  paths.  This  tradeoff 
should  not  be  a  casual  decision.  In  a  network  of  n  nodes, 
there  are  at  least  n(n-1)  best  paths.  With  some  of  the  most 
efficient  algorithms,  it  may  take  at  least  (n**3)  node  to 
node  messages  to  complete  one  network-wide  update  under  the 
worst  conditions  (see  Appendix  C) .  Therfore  it  is  desirable 
to  find  an  effective  update  frequency  which  provides  for 
realistic  and  efficient  network  traffic  flow. 
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In  addition  to  updating  existing  paths,  the  updating 
process  can  serve  to  introduce  new  links  into  the  network. 
In  some  protocols  such  as  Segall's  (Ref  2)  tne  arrival  of  a 
new  link  has  an  immediate  impact  on  the  network  update 
process.  As  in  the  case  of  broken  links  discussed  next, 
Segall  immediately  initiates  a  new  update  message  whenever  a 
node  experiences  a  change  in  its  link  status.  This  creates 
a  situation  where  update  messages  initiated  by  the  same  node 
may  be  negotiating  the  network  at  the  same  time.  Therefore 
there  must  be  provisions  to  prioritize  these  messages  so 
that  the  most  recent  message  takes  precedence  over  the 
outdated  messages.  This  is  normally  accomplished  by 
introducing  cycle  numbers  as  part  of  each  update  message  and 
many  other  network  management  messages.  The  problem  with 
cycle  numbers  is  that  they  can  potentially  grow  larger  than 
the  allotted  buffer  space.  Segall  places  a  bound  on  his 
cycle  numbers  by  using  a  procedure  devised  by  Finn  [Ref.  5]. 

One  of  the  objectives  of  this  study  is  to 
investigate  a  network  management  protocol  that  does  not 
require  cycle  numbers.  In  this  concept  new  links  are 
introduced  to  the  network  only  during  routine  updates.  It 
is  assumed  that  the  delay  involved  may  be  traded  for 
increased  simplicity. 
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2.   Link  Breakdown 

Broken  links  may  have  various  impacts  on  a  network. 
If  a  link  is  under  heavy  use,  a  break  may  have  a  serious 
effect  on  net  traffic  flow.  Heavy  use  may  also  indicate 
that  many  other  nodes  rely  on  this  particular  link  in  their 
best  paths  to  other  distant  nodes.  On  the  other  hand,  some 
links  may  serve  very  few  nodes,  and  in  fact  be  inactive  ar 
the  time  a  break  is  discovered. 

The  objective  of  any  reaction  to  a  broken  link  is  to 
minimize  its  impact  on  the  flow  of  traffic  and  other  network 
activity.  Ideally,  traffic  should  immediately  and 
automatically  be  switched  to  the  next  best  path.  One  way  to 
incorporate  alternate  links  under  certain  circumstances  is 
described  in  Appendix  A  and  is  considered  along  with  the 
proposed  network  management  protocol  in  Chapter  IV. 

When  it  cannot  always  immediately  reroute  traffic, 
the  network  management  protocol  must  take  action  to  stop  or 
reduce  traffic  intended  for  a  broken  link,  cause  the  network 
to  find  new  best  paths  for  traffic  affected  by  the  break,  or 
a  combination  of  both.  Finding  new  best  paths  is  typically 
done  during  an  update  operation.  It  is  a  function  of  a 
protocol  to  indicate  how  an  update  may  be  initiated. 
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In  some  protocols  discovery  of  a  break  aay  initiate 
an  update.  For  example,  the  discovering  node  may  broadcast 
a  special  update  request  message  addressed  to  each 
destination  for  which  the  discovering  node  had  considered 
the  broJcen  link  as  part  of  a  best  path.  Other  nodes  echo 
the  request  and  eventually  the  destination  nodes  receive 
their  requests  and  initiate  an  update.  In  this  concept, 
some  type  of  cycle  number  would  be  required  to  mediate 
conflicts  between  new  and  outdated  updates  from  a  single 
destination  node  which  could  exist  in  the  network  at  the 
same  time. 

Alternatively,  a  protocol  can  be  designed  to 
routinely  issue  updates  from  each  node  at  a  rate  that 
ensures  that  any  previously  issued  update  message  from  a 
particular  node  had  already  passed  out  of  the  network,  yet 
often  enough  to  tolerate  freezing  traffic  blocked  oy  a 
broken  link  until  the  next  routine  update  provides  a  new 
best  path.  This  is  the  basis  of  the  network  management 
protocol  proposed  in  Chapter  IV. 

C.   aSER  SERVICE  PROTOCOL 

Once  a  network  is  constructed  and  operational,   the  last 
question  is   how  routine  user   traffic  will  be   packaged  and 
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processed  by  each  node  in  the  network.  This  could  be 
considered  the  Oser  Service  Protocol  level.  In  this  case 
the  designer  may  assume  that  lower  level  protocols  will  work 
independently  to  do  things  such  as  update  best  paths,  react 
to  new  or  broken  links,  and  acknowledge  transmissions  across 
a  link.  The  User  Service  Protocol  uses  selected  information 
from  lower-level  protocols  to  efficiently  accomplish  its 
primary  function  of  passing  user  traffic. 

The  basic  characteristic  of  a  user  service  protocol  in  a 
packet  radio  network  is  that,  like  other  lower  level 
protocols,  it  should  be  transparent  to  the  user.  Decisions 
such  as  packet  size,  content,  and  processing  depend  on  the 
capabilities  of  the  selected  equipment  and  the  priorities  of 
the  network  designer.  In  this  section  a  particular 
algorithm  is  discussed  as  an  example  of  a  typical  user 
service  protocol.  It  is  presented  to  illustrate  one 
possible  technique  for  managing  routine  traffic  within  the 
framework  of  a  network  operating  with  other  lower  level 
protocols, 

1 ,   Voice  Traffic 

Several  assumptions  must  be  made   in  order   to  gain 
physical  appreciation   of  the  requirements  of   a  conceivable 
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packet  radio  networlc.  Some  of  the  parameters  selected  both 
here  and  in  the  remainder  of  this  study  are  based  on  a 
theoretical  packet  radio  concept  proposed  for  a  Marine 
Amphibious  Brigade  by  Bond  [Ref.  6],   and  Lucke  [Ref.  7]. 

It  is  assumed  that  the  network  will  move  both  voice 
and  data  traffic.  In  this  section  we  discuss  the 
characxeristics  and  requirements  of  each  type  of  traffic. 
As  mentioned  in  Chapter  II,  voice  must  flow  at  a  consistent, 
periodic  rate.  Data,  on  the  other  hand,  can  move  in  bursts 
as  channel  capacity  becomes  available. 

In  a  digital  network,  voice  must  be  converted  to  a 
digital  signal  (vocoding) .  This  is  done  by  sampling  the 
analog  voice  signal  and  converting  each  sample  to  a  digital 
value.  This  produces  a  voi^e  packet.  In  a  real-time 
conversation,  any  delay  of  more  than  approximately  0.1  sec 
between  speakers  becomes  noticeable.  Therefore  a  voice 
packet  should  take  no  more  than  0.1  sec  to  move  from  the 
source  node  to  the  destination  node.  Assuming  that  packets 
will  be  relayed  by  a  maximum  of  10  nodes  in  our  theoretical 
network,  and  further  assuming  that  processing  time  in  each 
node  is  far  more  significant  than  the  propagation  time 
between  nodes,  then  the  maximum  processing  delay  per  node  is 
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Because  cf  the  periodicity  requirements  of  voice, 
there  are  certain  advantages  to  establishing  a  virtual  link 
between  the  traffic  source  and  destination.  In  a  packet 
radio  network,  a  virtual  link  may  consist  of  reserving  a 
time  slot  on  each  link  along  the  best  path  from  the  source 
to  destination  at  the  time  the  virtual  link  is  established. 
Once  a  virtual  link  is  established,  it  is  used  until  the 
source  node  has  finished  the  voice  conversation  (unless  a 
link  is  broken) ,  regardless  of  whether  or  not  subsequent 
update  operations  have  found  other  best  paths  during  the 
course  of  the  conversation.  This  ensures  periodicity  in  the 
voice  traffic,  for  each  voice  packet  passes  thru  rhe  same 
number  of  nodes,  with  the  same  net  processing  time  for  a 
given  source-deszination  pair. 

In  a  practical  network,  a  link  would  probably  be 
required  to  accommodate  traffic  for  more  than  one  node  at  a 
time.  As  implied  in  the  previous  paragraph,  this  may  be 
accomplished  by  transmitting  traffic  for  a  specific 
destination  node  in  an  assigned  time  slot  on  each  link. 
This  is   also   called  time   division   multiplexing.     The 
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particular  slot  on  each  link  enroure  to  a  destination  is 
determined  as  the  call  is  being  initiated  and  the  virrual 
link  is  being  built.  Once  established,  this  slor  will  only 
carry  voice  packets  for  its  assigned  destination  until  the 
virtual  link  is  broken  or  dismantled. 

It  is  convenient  to  define  the  series  of  time  slots 
which  can  each  carry  a  separate  virtual  link  as  a  Frame. 
Then  in  each  frame,  one  slot  represents  one  virtual  link  to 
a  destination.  During  normal  link  operation,  each  frame  is 
followed  by  another  frame  carrying  the  next  voice  packet  in 
the  assigned  slox  for  each  virtual  link  (see  Fig.  3.1). 


t  -* — j  1  j  2  j  3  I        sequence  of  slots 

V — 

frame 


^ y ' 


I         I  I  sequence 

t  -« 1    1|2|3|1|2|312...         of 

/v ^^ frames 


V .^ ^«^ 


frame        frame       frame 


Fig.  3.1.   Slot/Frame  Concept 


It  was  estimated  above  that  if  a  maximum  of  10  nodes 
were  used  in  a  virtual  link,  each  node  can  take  up  to  .01 
SQC     to  retransmit  one   voice  packet.     If  it  is   furrher 
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assumed  that  each   frame  must  handle  up  to  10  virtual  links 

(slots)  ,  then  each  slot  (which  carries  one  voice  packet)  can 

be  no  more  than   1  msec  because  each  frame  can   last  no  more 
than  .01  sec. 


.01  sec/frame 
Slot  Duration  =  ---————  =  i  msec/slot. 

10  slots/frame 


It  is  estimated  that  good  quality  digital  adaptive 
Delta-mod  voice  requires  a  bit  rate  of  16  x  (10**3) 
bits/sec.  In  the  multiplexing  system  mentioned  above,  each 
voice  channel  has  only  a  1/10th  duty  cycle.  Therefore  when 
active,  a  virtual  link  must  pass  traffic  at  a  rate  of  160  x 
(10**3)  bits/sec. 

For  this  example,  if  the  radios  in  this  network 
operate  with  a  bandwidth  of  approximately  100MHz  (spread 
spectrum),  a  significant  PQst  detection  processing  gain 
could  be  obtained 


Transmission  Bandwidth        10**3 
G  = 


Bandwidth  of  Message        160  x  (10**3) 
=  625  =  28  dB. 
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2.   Data  Traffic 

Data  traffic  would  not  normally  have  the  stringent 
timing  requirements  that  voice  traffic  may  require.  On  the 
other  hand,  within  reason,  voice  traffic  could  afford  to 
randomly  lose  packets  while  experiencing  a  graceful 
degradation  in  the  actual  flow  of  information,  whereas  any 
lost  data  packets  represent  an  absolute  loss  of  information. 
Therefore  the  network  may  pass  data  traffic  more  slowly,  bur 
must  do  so  more  accurately. 

Because  of  the  periodicity  requirement  of  voice 
traffic,  voice  packets  need  to  have  priority  over  dara 
packets.  Under  this  network  concept,  data  traffic  would  be 
integrated  -as  a  filler  in  available  sloxs  during  pauses  in 
voice  traffic.  The  result  is  bursts  of  data  traffic,  which 
does  not  lend  itself  to  the  virtual  link  concept  described 
for  voice  traffic.  In  fact  it  may  be  simpler  to  picture 
each  data  packet  as  an  individual  message  containing  rhe 
address  of  the  destination,  and  being  released  by  the  source 
node  to  find  its  way  to  the  destination  node.  One  advantage 
of  this  concept  is  that  if  the  network  updates  its  best 
paths  while  a  source  node  is  releasing  data  packets  for  a 
particular  destination,   later  packets  have  the  advantage  of 
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using  the  updated  best  paths  to  their  destinarion.  By 
contrast,  in  the  virtual  linJc  concept  considered  here,  once 
a  virtual  link  is  established,  traffic  is  confined  to  it 
even  though  better  paths  may  become  available. 

If  data  traffic  is  to  be  moved  on  the  networic 
developed  earlier,  it  must  be  able  to  work  within  the 
frame/slot  concept  devised  for  voice  traffic.  Assuming  a 
slot  has  a  duration  of  1  msec  with  a  data  rate  of  160  x 
(10**3)  bits/sec,  then  each  slot  contains  approximately  160 
bits  of  information.  In  the  virtual  link  concept  this  may 
be  perfectly  acceptable  because  once  the  virtual  link  is 
established,  nearly  all  bits  passed  on  the  virtual  link  are 
user  traffic.  However,  if  each  data  packet  is  to  move 
independently  from  the  source  node  to  the  destination  node, 
each  packet  must  contain  certain  overhead  information  which 
is  commonly  lumped  together  at  the  beginning  of  the  packet 
in  a  preamble. 


PRSAMBLS 


USER  DATA  ^ 


DESTINATION  i  JISG.NO.  ;   PACKET  NO.  ■■     SOORCS  i  USER  ID 


Fig.  3.2.   Preamble 
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The  preamble  in  Fig.  3,2  illustrates  some  of  the 
information  that  might  be  required  in  the  heading  of  a  data 
packet.  If  this  information  were  to  require  a  portion  of 
the  available  bits  in  every  slot,  it  would  seriously  degrade 
the  rate  at  which  user  data  could  be  passed.  An  alternative 
is  to  use  much  larger  data  packets. 

Data  packets  are  typically  created  as  the  source 
node  divides  up  a  stream  of  data  from  a  buffer  which  is 
being  fed  by  a  console,  facsimile  device,  etc.  The  size  of 
the  packets  is  dictated  by  the  user  service  protocol. 
Therefore  the  number  of  data  packets  needed  to  carry  the 
users  entire  message  is  obviously  a  function  of  the  messages 
size  and  the  size  of  a  data  packet.  On  the  receiving  end, 
not  only  must  all  data  packets  be  received  (correctly) ,  but 
it  may  be  required  to  sort  the  packets  to  place  them  in  the 
proper  order,  meaning  each  packet  must  be  serial  numbered. 
Information  such  as  this  does  not  contribute  zo  the  net  flow 
of  user  information.  Therefore  to  pass  the  largest  possible 
ratio  of  user  information  to  preamble  information  with  the 
slot  technique,  a  data  packet  including  preamble  should  be 
some  larger  multiple  of  a  voice  packet. 
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when  data  packets  are  transmitted  across  a  link,  the 
sending  node  reads  the  preamble  of  the  data  packet  and 
assigns  a  slot  number  on  the  best  path  link  toward  the 
destination  node.  The  sending  node  rhen  divides  the  data 
packet  into  sub-packets  which  are  the  size  of  a  slot. 
Depending  on  the  standard  size  of  a  data  packet,  the  sending 
node  sends  the  remainder  of  the  data  packet  in  the 
appropriate  slot  in  consecutive  frames.  The  receiving  node 
is  also  programmed  to  accept  a  standard  number  of 
sub-packets  once  it  has  agreed  to  accept  a  data  packet  in  a 
particular  slot.  In  this  way  only  one  preamble  is  sent  per 
data  packet  and  the  effective  ratio  of  user  information 
actually  passed  could  be  significantly  increased. 

This  procedure  is  essentially  another  version  of  the 
virtual  link.  Depending  on  the  number  of  sub-packets  and 
system  priorities  for  handling  sub-packets,  a  virtual  link 
for  a  data  packet  may  vary  in  size.  For  example,  if  nodes 
are  programmed  to  relay  sub-packets  as  soon  as  they  are 
successfully  received,  several  nodes  on  the  best  path  may  be 
relaying  portions  of  a  single  data  packet  at  the  same  time. 
In  fact,  the  destination  node  may  be  receiving  the  first 
subpackets  before  the  last  subpackets  are  transmitted.    The 
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difference  is  that  these  virtaai  linics  have  a  fixed  finite 
lifespan.  They  are  limited  by  the  amount  of  time  the 
designer  wants  to  make  a  slot  unavailable  to  voice  rraffic. 
An  extension  of  the  same  idea  has  two  or  more  slots  in  the 
same  frame  being  used  to  pass  sub-packets  of  the  same  data 
packet.  This  provides  a  more  efficient  use  of  a  link  which 
may  have  little  voice  traffic  and  is  consistent  with  the 
bursty  nature  of  traffic. 

3 .   Integrated  Management  Traffic 

With  the  exception  of  the  preamble,  there  has  been 
no  mention  of  management  traffic  which  is  required  by  node 
to  node  and  network  management  protocols.  Typically  this 
traffic  consists  of  relatively  short  messages.  It  is 
conceivable  that  these  messages  could  be  tagged  on  the  end 
of  user  packets  placed  in  each  slot.  In  this  situation  it 
would  appear  to  the  network  that  100  percent  of  channel 
capacity  was  available  to  user  traffic.  If  this  is  no^ 
practical,  then  slots  could  be  used  on  an  as-needed  oasis  zo 
pass  groups  of  Management  messages. 

There  is  another  aspect  of  traffic  management  that 
may  be  considered.  Once  voice  traffic  is  interrupted,  it  is 
important  that   the  speaker  be   notified.    This  could  be  a 
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programmed  response   to  the  network's   reaction  to  a  broken 
link.   The  result  would  be  for  the  speaker  to  quit  talking. 

Similarly,  for  data  traffic  it  is  practical  for  the 
source  node  to  release  only  a  limited  number  of  data  packets 
into  the  network  and  wait  for  a  receipt  acknowledgement  from 
the  destination  node  as  data  packets  arrive.  This  is  called 
"flow  control".  This  prevenrs  a  source  node  from  loading 
interim  nodes  with  excessive  traffic  which  the  network  may 
not  be  able  to  process  because  of  a  lost  link  to  the 
destination.  Ii:  also  allows  the  source  node  to  selectively 
retransmit  packets  that  were  not  successfully  received  and 
erase  those  that  were.  finally,  it  provides  assurance  that 
the  data  traffic  was  received. 
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IV.   A  DISTRIBtJTED  NETWORK  MANAGEMENT  PROTOCOL  CQNCEPI 

This  chapter  describes  a  particular  concept  for  a 
distributed  control  network  management  protocol.  This 
protocol  is  limited  by  design  to  fit  into  the  larger  concept 
of  independent  levels  of  protocol  which  handle  different 
classes  of  messages,  processed  as  described  in  Chapter  III. 
Analysis  of  the  protocol  developed  here  by  a  computer 
simulation  is  discussed  in  Chapter  V. 

A.   SETTING  THE  FRAMEWORK 

The  following  network  management  protocol  is  based  on 
the  assumption  that  an  adequate  node  to  node  protocol  is 
performing  necessary  functions  such  as  periodically  testing 
links,  discovering  new  as  well  as  broken  links,  and 
confirming  when  a  packet  has  been  successfully  transmitted 
across  a  link. 

It  is  further  assumed  that  the  result  of  this  protocol, 
which  is  intended  to  be  a  flexible  network  which  can  react 
to  link  changes  and  find  new  best  paths  based  on  the  latest 
channel  values,  will  be  used  by  a  higher  level  user  service 
protocol.  This  higher  protocol  could  resemble  that 
described  in  Chapter  III.   But  it  is  not  necessary  to  define 
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a  particular  user  service  protocol  in  order  to  investigate  a 
lower  level  network  nianagemenx  protocol.  Therefore  the 
remainder  of  this  study  will  minimize  any  assumptions  about 
the  form  of  higher  level  protocols  which  may  use  the  results 
of  this  network  management  protocol . 

B.   DEFINITIONS 

All  the  most  common  components  of  our  network,  such  as 
nodes  and  links,  have  already  been  mentioned.  However  it  is 
necessary  here  to  further  describe  certain  previously 
defined  components,  and  to  present  additional  components  or 
concepts  needed  to  explain  the  protocol. 

1 .   The  Basic  Group 

The  Basic  Group  is  what  has  been  defined  as  the 
network  up  to  this  point.  A  basic  group  is  a  collection  of 
nodes,  each  having  a  unique  identification,  each  being 
connected  to  at  least  one  other  node  in  the  basic  group,  and 
each  node  being  considered  an  equal  member  of  the  group  (See 
Fig.  4,1).  By  using  only  links  belonging  to  the  basic 
group,  it  is  possible  to  send  a  message  from  any  node  in  the 
basic  group  (called  the  Source)  to  any  other  node  (called 
the  Destination) . 
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Fig.  4.1.   Example  of  a  Basic  Group 


Our  network  management  protocol  will  initially  be 
developed  with  nothing  more  than  a  basic  group.  Later,  a 
version  of  the  protocol  involving  "Related  Groups"  and 
"Families  of  Groups"  will  be  introduced.  However  this  will 
have  little  impact  on  the  basic  concept. 

In  order  to  move  user  traffic  efficiently,  the 
protocol  must  be  able  to  calculate  the  best  route  from  a 
source  to  destination  node.  To  do  this,  each  link  is 
assigned  a  channel  value,  and  these  values  are  summed  and 
compared  to  determine  the  best  path  from  the  source  to 
destination  node.  It  is  not  essential  to  specify  in  advance 
the   exact  physical   nature  of   these  channel   values,    or 
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distances  as  they  are  sometimes  called.  But  whatever 
channel  value  physically  amounts  to,  it  should  reflect  the 
relative  "cost"  of  sending  traffic  over  a  link  at  the  time 
it  is  measured. 

A  best  path  implies  that,  based  on  existing  links 
and  currant  channel  values  at  the  time  it  was  measured, 
there  is  at  least  one  combination  of  links  whose  net  channel 
value  represents  the  most  efficient  path  from  the  source  to 
destination.  This  is  frequently  considered  the  minimum 
delay  route.  Best  paths  can  become  outdated  for  two 
reasons:  either  one  of  its  links  is  broken  making  movement 
impossible,  or  another  combination  of  links  develops  a  -lower 
net  channel  value. 

It  should  be  noted  that  each  link  is  a  two  way 
communications  channel,  and  usually  the  current  channel 
value  in  one  direction  has  no  relationship  to  the  channel 
value  in  the  other  direction.  In  Fig.  4.2  below,  the 
channel  value  from  nodes  A  to  B  is  1 .  However  the  channel 
value  from  nodes  B  to  A  is  5.  This  means  that  for  any  two 
nodes  in  a  basic  group,  the  best  path  from  the  first  node  to 
the  second  is  not  necessarily  the  best  path  from  the  second 
node  to  the  first.  Thus  in  any  basic  group  of  N  nodes, 
there  are  N(N-1)  cr  approximately  N*5*2  possible  best  paths. 
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Channel    values 


n 


Fig.    4.2.      Channel   Values  on  a   Two-way   Link 

2 .   Activities 

In  the  coarse  of  maintaining  the  network,  the 
protocol  will  cause  each  node  to  initiate  and  participate  in 
several  management  activities.  Most  have  already  Dsen 
mentioned  and  will  only  be  discussed  briefly  here. 

The  best  path  update  is  the  fundamental  operation  of 
this  level  of  protocol.  As  channel  values  change  and  best 
paths  become  outdated,  steps  must  be  taken  to  find  the  new 
best  path.  This  process  is  automatically  and  asynchronously 
initiated  by  each  node^  and  when  it  is  completed  (which  may 
require  the  origination  of  several  update  cycles  as 
discussed  below) ,  every  other  node  in  the  basic  group  knows 
the  latest  best  path  to  the  initiating  node.  This  operation 
is  periodically  required  of  every  node  in  the  network.    The 
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reason  why  complete  updating  of  the  best  paths  may  require 
more  than  one  initiation  or  an  update  cycle  can  be  seen  in  a 
simple  example.  In  the  network  in  Fig.  4.3,  node  k  sends 
out  an  update  message  to  nodes  3  and  C.  Node  C  updates  its 
channel  value  to  A  from  5  to  4  but  still  retains  its  old 
best  path  thru  node  3  believing  it  has  a  total  channel  value 
of  3.  Finally  after  node  B  relays  k* s  update  massage  to  C, 
node  C  learns  that  the  actual  channel  value  thru  node  B  to  A 
is  now  7.  When  A  initiates  its  next  update,  node  C  will 
change  its  best  path  to  node  A  to  be  the  direct  A-C  linJc. 


/channel  values  as  of  last 
update 

/  Channel  values  now 


Pig,  4,3.   Update  Iterations 


A  broken  link  can  be  a  traumatic  event  in  the 
network.  Therefore  the  protocol  will  react  to  broken  links 
in  an  attempt   to  minimize  the  effect  on   user  traffic  flow. 
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First  it  will  attempt  to  switch  all  traffic  hampered  by  the 
broken  link  to  an  alternate  link.  An  alternate  link  is 
defined  only  in  respect  to  individual  nodes,  and  if  one  is 
available,  it  may  be  used  by  a  node  if  the  node  is  faced 
with  an  inability  to  move  traffic  over  a  previous  best  path 
which  now  contains  a  broken  link.  An  alternate  link  can 
only  be  considere<J  as  a  temporary  fix.  Its  only  guarantee 
is  that  if  used,  it  will  not  create  a  loop  situation.  A 
loop  is  defined  as  a  closed  path  consisting  of  a  series  of 
links.  Therefore  traffic  leaving  a  loop  node  will 
eventually  return  to  that  node.  In  Fig.  ^.'i/  node  2  cannor 
consider  the  link  to  node  4  as  an  alternate  link  if  node  4 
routes  traffic  destined  for  node  1  through  node  3,  This 
creates  a  loop.  However  if  node  2  can  be  assured  that  node 
4  will  not  route  traffic  destined  for  node  1  on  any  path 
which  eventually  moves  through  node  2,  then  node  2  can 
switch  traffic  tc  node  4  after  a  break  with  confidence  that 
it  retains  a  loop-free  network. 

Although  switching  traffic  of  a  best  path  implies  a 
decrease  in  efficiency,  the  alternate  may  be  to  stop  all 
traffic  routed  over  a  broken  link.  Of  course  this  may  be 
even  less  efficient.   But  a  node  faced  with  the  decision  may 
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Best    Path    Link 


LOOD 


Loop-free 


Before    Break 


After    Break 


Fig.    4.4.      Loop 


not      always    have     the      option   of      an     alternate   linlc.  See 

paragraph  C3  below  and  Appendix  A  for  a  discussion  and  proof 
of  an  alternate  link  concept  which  is  compatible  with  the 
network   management   protocol  described   in   this  chapter. 

Clearly,  it  is  required  that:  a  node  be  able  zo  cope 
with  a  situation  where  it  may  lose  all  access  to  one  or  more 
nodes*  Recovery     is   defined      as      eventually      establishing 

another   path   to    the    disconnected      nodes.        The   efficiency    of 
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recovery   is   defined   as   the  speed  at  which   a  path   is 
reestablished  over  the  new  best   path. 

To  accomplish  the  above  activities,  each  node  in  the 
network  will  create,  process  and  relay  messages  from  other 
nodes.  The  processing  will  frequently  change  components  of 
a  message  that  a  node  receives  from  a  previous  node,  adding 
information  to  the  message  before  relaying  it.  Nodes  are 
also  selective  as  to  which  other  nodes  it  will  send  or  relay 
a  message.  The  net  result  is  to  improve  network-wide 
operation  and  efficiency. 
3 .   Messages 

The  network  managemenr  protocol  is  required  to  send 
two  types  of  overhead  messages  related  re  the  maintenance 
activities  mentioned  in  the  previous  paragraph.  2ach 
message  will  have  several  elements  which  will  be  abbreviated 
and  represented  in  a  message  argument. 

a.   Update  Message 

The  symbol  for  an  update  message  and  its 
components  are  shown  below.  The  letter  1  identifies  the 
last  node  to  relay  the  update  message  (or  d-msg) .  The 
letter  d  identifies  the  originator  of  the  U-msg.  Note  that 
when  the  originator  first  sends  the  a-msg,  l=d.  D (1)  is  the 
cummulative  channel  value  on  the  best  path  from  i  to  d. 
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apdate  Message  ==>  U(l,d,D(l)) 

b.   Broken  Path  Message 

The  symbol  for  a  broken  path  message  and  its 
components  are  shown  below.  The  argument  d  represents  the 
destination  node  for  which  the  broken  link  is  blocKing 
traffic,  and  corresponds  to  the  d  in  the  U-msg.  The  d  in 
the  a-msg  is  the  identity  of  the  initiating  node,  and 
represents  the  destination  to  which  the  best  paths  created 
by  this  U-msg  will  point.  The  d  in  the  X-msg  indicates  that 
the  best  path  to  d  is  broken. 

Broken  Path  Message  ==>  X  (d) 


C.   THE  CONCEPT 

The  objective  of  this  network  management  protocol  is  to 
provide  a  single  algorithm  that  can  operate  autonomously  in 
each  node  of  a  network  to  provide  completely  decentralized 
network  control,  yet  provide  for  efficient  traffic  routing. 
This  algorithm  was  also  chosen  for  its  relative  simplicity 
and  potential  robustness.  Its  primary  departure  from  most 
other   algorithms  of   this  nature  is   that   it  attempts   to 
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accommodate   new  and   broken  link   events  without  requiring 
cycle  numbers.   The  algorithm  is  given  in  Appendix  B. 
1 ,   Normal  Operations  without  New  or  Broken  Links 

It  is  most  convenient  initially  to  study  the  update 
process  while  freezing  the  status  or  nodes  and  links.  We 
will  also  initially  assume  each  node  has  a  best  path  to 
every  other  node.  As  mentioned  earlier,  the  basic  group  or 
network  consist  of  N  nodes.  The  number  of  links  between 
these  nodes  will  normally  exceed  the  number  of  nodes. 
Normally,  if  they  are  evenly  distributed,  the  more  links 
into  an  average  node,  the  more  robust  is  the  network. 

To  efficiently  use  a  network,  traffic  should  take 
the  best  path  from  the  source  to  destination  node.  To 
identify  and  use  this  path,  each  node  along  the  way  must 
know  the  destination  of  -he  traffic,  and  what  neighboring 
node  is  downstream  on  the  best  path  to  each  destination. 
Downstream  will  imply  aovemenr  toward  the  destination,  that 
is,  relaying  the  traffic  to  another  node  with  a  smaller 
cummulative  channel  value  to  the  destination.  Upstream 
implies  movement  away  from  the  destination,  noraally 
backwards  along  the  best  path.  The  update  message  allows 
each  node  to  determine  which  neighbor  is  on  its  best  path  to 
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every  other   node  in  the   network.    Each   node  periodically 
initiates  a  U-msg  to  all  its  neighbors.   In  Fig.  4.5  node  1 


Fig.  4.5.   Initiating  an  Opdate 


initiates  an  update  by  sending  U  (1,1,0)  to  nodes  2  and  4. 
When  a  node  receives  a  U-msg  ititiated  by  d,  it  computes  the 
cummulative  channel  value  to  d  thru  1  and  compares  it  to  the 
last  cummulative  channel  value  along  the  node's  current  besz 
path  to  d.  For  example,  in  Fig.  4.5,  suppose  node  4  had 
previously  selected  the  direct  link,  with  channel  value  =  5, 
as  its  best  path  to  node  1.  Meanwhile  node  2  has  also 
received  a  0-msg  from  node  1,  has  determined  that  this  is 
its   best  path   to  node   1  because   no  other  path  offers   a 
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c'lmmulative  channel  value  of  ^,  and  has  relayed  node  ^*s 
U-msg.  Node      2   sends      a      modified      U-msg      to    all      of      its 

neighbors  except  the  neighbor  from  which  it  received  the 
U-msg.  Now   the      0-msg      is     updated   with      the      cummuiative 

distance  from  node  2  to  node  1.  Let  d  (i,l)  be  the  channel 
value  on  the  link  from  a  node  i  to  any  neighbor  1.  Then  the 
cummuiative   channel   value    from   node   2   to   node   1    is 

d  (2,  1)    +    D  (1)    =    1    +    0   =    1. 

D  (1)  is  taken  from  the  U-msg  received  by  node  2  from  node 
1.  d(1,2)  is  calculated  at  some  earlier  designated  time 
when  all  nodes  in  the  network  simutaneously  calculate  and 
fix  channel  values  to  each  of  their  neighbors  (this 
procedure  is  discussed  in  greater  detail  in  Chapter  V) . 
Therefore  the  U-msg  relayed  to  node  2's  neighbors  is 
U(2,1,1)  which  states  that  node  2  is  relaying  a  U-msg  from 
node  1  and  the  cummuiative  channel  value  through  node  2  to 
node    1    along   its   best   path   is    1. 

When  node  4  receives  the  U-msg  from  node  2,  it  once 
again  processes  the  message  in  a  standard  fashion.  As  shown 
in  Fig.  4.6,  the  channel  value  from  node  U  to  node  2  is  3 
(d(4,3)=3).  Now  upon  receiving  the  U-msg  from  node  2,  node 
4    calculates   the   cummuiative   channel  value   through  node   2    to 
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Best    Path    link   to   node    1 


Fig,    4,6,      Node   2  Relays    Mode    Vs    O-nsg 


the  initiator  of  the  U-msg  (d=node  1) .  For  node  U  in  this 
example 

a  (U,2)     +    D  (2)     +    3    +     1=4. 

When  node  4  compares  this  value  with  the  latest  cuamularive 
channel  value  for  its  best  path  to  node  1  (which  node  i  will 
define  as  the  symbol  3  (d) )  it  will  find  that  it  is  aore 
efficient  tc  go  thru  node  2  to  get  ro  node  ^,  or  B(1)=2. 
Note  that  in  future  discussions  the  rera  "Best  Path"  will 
imply  the  optimum  series  of  links,  whereas  B (d)  will 
indicate  a  specific  neighboring  node  which  a  transmitting 
node  considers  as  the  nex*  downstream  node  on  the  best  path 
to  destination  d. 
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In  this  example,  node  4  receives  a  U-msg  which 
enables  it  to  improve  its  best  parh  to  d.  Any  node  which 
changes  its  best  path  or  the  cammuiative  channel  value  for 
its  current  best  path  must,  in  turn,  relay  this  information 
to  all  of  its  neighbors  (except  B  (d)  .  This  is  necessary 
because,  given  this  new  inforaarion,  an  upstream  neighbor 
may  have  an  opportunity  to  update  its  B  (d)  .  On  the  other 
hand,  if  a  node  receives  a  U-msg  which  does  nor  change  the 
node's  B (d)  or  cummulative  channel  vlaue  to  d,  it  will  not 
relay  the  U-msg.  This  is  acceptable  because  the  upstream 
nodes  already  have  access  to  the  current  route  which  is 
considered  more  efficient  than  a  route  through  the  node 
which  relayed  the  lasx  U-msg. 

Deletion  of  update  messages  is  an  important 
function.  If  the  network  were  net  allowed  to  eliminate 
useless  messages,  i*  could  impose  a  significant  unnecessary 
burden  on  the  management  traffic  load.  In  a  network  of  N 
nodes,  there  are  approximately  N**2  best  paths.  If,  when 
each  node  initiated  an  update  operation,  every  other  node 
indiscriminately  relayed  the  update  message,  there  would  be 
a  minimum  of  approximately  Nx (number  of  links)  update 
messages  generated  when  each  node   originates  an  update  in  a 
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network   of    N  nodes.        Therefore   to    control   this    growth,      the 
first   node   to   receive  a    useless   fJ-asg   eliminates   it. 

Fig.  4.7  shows  the  complete  network  with  channel 
values  and  best  paths  from  all  nodes,  to  node  1 ,  before  and 
after  update.  The  order  in  which  U-msgs  arrive  at  a  node 
can  significantly  affect  the  number  of  U-msgs  generated  in 
reaching  the  optimum  solution.  But  (assuming  static  values 
for  the  channel  values)  the  end  result  will  always  be 
optimum,  even  though  iz  may  require  several  update 
initiation  cycles  to  stabilize.  The  following  is  a  sequence 
of  events  that  could  have  occurred  to  update  the  network  in 
Fig.    4.7. 

Node  1  generates  U  (1,1,0)  and  sends  it  to  Nodes  2 
and  4  . 

Node      4    receives      Node    1's      U-msg.  Since   i;his      is 

already      its      B(1),         it      updates      its      net      channel      value, 
generates    0(4,1,5)    and    sends   ir    to    nodes   2,3,    and    5. 

.Meanwhile  Node  2  receives  Node  1*s  'J-msg  upstream 
along  its  3(1),  updates  its  net  channel  value,  generates 
U  (2,1,1)     and    sends    it   to    Nodes    3   and   4. 

Node  2  receives  Node  4»3  0(4,1,5),  compares  it  to 
3(1),    and    discards   it. 
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before  update 


a  Best 
Path  link  to 
node  1  or  3P(1) 


after  update 


Fig.  4.7.   Complete  network  with  Channel  Values  and  BP(1)»s 
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Node  3  receives  Node  U«s  U  (4^1,5),  compares  it  to 
its  latest  B(1)  and  discards  it. 

Node  5   receives  U(4,1,5)   upstream  from  its  3(1)  , 
generates  U  (5, 1,10)  and  sends  it  to  Nodes  3  and  6. 

Now  node  4  receives  Node  2's  0(2,1,1),  compares  it 
to  its  last  B(1)  and  selects  a  new  6(1) =2.  Since  it  changed 
3(d),  Node  a  issues  U  (H , ^  ,M)  to  Nodes  3  and  5  which  will 
eventually  be  discarded  by  both  nodes. 

Meanwhile  Node  3  receives  Node  2»s  U  (2, 1 , 1) ,  updates 
its  3(1)  and  generates  U(3,.1,3)  for  Nodes  4,5  and  6. 

Node  5  receives  Node  3* s  0(3,1,3),  finds  this  better 
than  its  previous  B(1)  and  sets  B(1)=3.  Now  Node  5  must 
also  issue  0(5,1,4)  to  Node  4  and  6. 

Node  3  receives  Node  5*s  previous  0(5,1,10)  and 
discards  it.  Node  4  receives  Node  5*s  later  0(5,1,4)  and 
also  discards  it. 

Node  6  initially  received  Node  5's  0(5,1,10)  but 
retained  its  old  3(1)=3.  Later  Node  6  received  0(5,1,4). 
This  time  it  finds  this  path  much  better  and  sets  B(1)=5. 
It  also  issues  0(6, 1,6) to  node  3.  Eventually  Node  6 
receives  0(3,1,3)  but  discards  it.  Finally,  Node  3  receives 
0(6,1,6)  and  discards  it. 
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In  the  above   example,   the  senerio  would  have  been 
slightly  changed  had  messages  arrived   in  a  different  order, 
but  the  ultimate  best  path  results  would  be  the  same. 
2.   Introducing  New  and  Broken  Links 

Realistically  a  network  must  integrate  new  links  and 
recover  from  broken  links.  Later  the  "Alternate  Link",  as 
an  interim  fix,  will  be  discussed.  But  initially  we  shall 
assume  that  there  are  no  known  routes  remaining  from  the 
node  which  detects  the  broken  link,  to  some  destination. 
Assume  also  that  traffic  for  this  destination  may  already  be 
stored  in  the  detecting  node,  or  enroute  to  it  under  the 
assumption  that  the  broken  link  is  still  intact.  The 
network  management  protocol  must  provide  for  a  graceful 
recovery. 

In  order  to  eliminate  the  added  complexity  of  cycle 
numbers,  the  protocol  is  restricted  to  initiating  one  U-msg 
from  any  one  node  in  the  network  at  one  time.  This  means 
that  there  must  be  enough  time  for  an  update  cycle  or 
session  initiated  by  a  node  to  propagate  thru  the  entire 
network,  updating  all  best  paths  as  it  goes.  When  a  break 
cuts  off  access  to  a  node,  it  is  important  that  a  new  update 
from  that  node  (cr  nodes)    be  initiated  and  propagated  thru 
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the  network  as  soon  as  possible  in  order  to  identify  new 
best  paths  so  that  stalled  traffic  can  continue  to  their 
destinations.  In  order  to  address  this  problem,  the 
protocol  assigns  the  highest  processing  priority  to  U-msgs. 
This  is  intended  to  allow  U-msgs  to  perform  the  update  (and 
therefore  eliminate  themselves  from  the  net)  as  soon  as 
possible.  At  the  same  time,  the  protocol  sets  the  frequency 
at  which  each  node  periodically  initiates  a  new  U-msg.  The 
idea  is  to  establish  a  practical  U-msg  initiation  frequency 
so  that  the  event  of  a  broken  link  does  not  require  a 
request  for  initiation  of  a  special  update  message,  and  ye-c 
does  not  leave  user  traffic  stranded  for  a  long  time. 

It  might  be  helpful  to  consider  an  example  of  this 
in  terms  of  the  user  service  protocol  example  in  Chapter 
III.  If  the  average  distance  between  nodes  is  approximately 
3  km  (based  on  the  Marine  Amphibious  Brigade  model)  then 
assuming  speed  of  light  propagation  the  signal  travel  time 
between  nodes  is 


3  km 

travel  time  =  =  10**-5  sec  =  10  usee. 

3  X  10=*^5  km/sec 


Furthermore  assume  a  network  or  basic  group  of  50  nodes,  and 
assume  a  longest  best  path  of  30  nodes.  Then  the  maximum 
total  travel  time  is 
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30  links  x  10  usec/link  =  300  usee. 

Assume  an  additional  20  usee  processing  time  in  each  node 
(when  protocol  messages  are  given  top  priority).  Then  the 
total  time  for  a  U-msg  to  process  thru  the  entire  net  is 
approximately  1  msec.  Therefore  if  the  protocol  required 
each  node  to  initiate  a  U-msg  every  .Isec  (or  once  every  10 
frames),  approximately  .Isec  +  1msec  is  the  longest  any 
traffic  should  be  stranded  due  to  a  broken  link.  This 
should  not  significantly  affect  data  traffic  which  is  bursty 
in  nature  anyhow.  Although  detectable  in  voice  traffic,  ir 
would  not  be  serious  unless  failures  occurred  repeatedly. 
This  situation  could  be  improved  by  increasing  the  frequency 
of  the  update  at  the  cost  of  more  network  management 
traffic. 

This  protocol  requires  that  traffic  which  is 
stranded  due  to  a  broken  link  wait  to  be  rescued  by  a 
routine  U-msg  from  the  destination  node  to  which  the  traffic 
is  addressed.  Yet  there  are  still  actions  which  can  be 
taken  -o  make  good  use  of  the  broken  link  informat-ion  and 
minimize  the  trauma  of  recovery.  Since  there  is  no 
assurance  that  any  of  the  nodes  close  to  the  break  will  be 
on  the  new  best  path,   it  is  probably  helpful  to  freeze  data 
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traffic      enroute    to      a   broken      link.  This   is      one   of      the 

functions    of   a   broken   path    message    (X-msg) . 


Best    Path    link   to    node    1 


Pig.    4,8.      Sending   the   X-asg    Upstream 


when   a      node   discovers    a   broken      link   on    one      of   irs 


best  paths,  it  initiates  a  X-msg  for  every  destination  node 
for  which  the  discovering  nodes  considered  the  broken  link 
as  part  of  the  best  path.  These  nodes  are  easy  to  identify 
because  this  is  the  same  information  used  for  normal  routing 
operations.  The  initiating  node  sends  rhe  X-msgs  to  all  of 
its  neighbors.  For  example,  as  shown  in  Fig.  4.8,  when  Node 
3  discovers  that  the  link  to  Node  2  (and  B(1))  is  broken,  it 
will   initiate   an    X-msg    which  is   X(1).         Note    in    this    example 
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that  th9  broken  link  could  also  be  Node  3»s  3(2),  also 
requiring  a  X  (2)  message.  But  for  simplicity  it  is  assumed 
that  Node  1  is  the  only  destination  in  this  network.  The 
X(1)  is  sent  to  all  of  Node  3*s  neighbors.  Node  4  and  6  do 
not  consider  Node  3  to  be  on  their  best  path  to  Node  1. 
Note  that  for  Node  4,  this  is  a  correct  assumption.  But  for 
Node  6  this  assumption  is  not  correct.  In  any  eveni:,  if  a 
node  receives  a  X-msg  from  a  non-best  path  neighbor,  it 
discards  the  X-msg  and  takes  no  other  action.  This  is  how 
useless    X-msgs   are   eliminated. 

Node  5,  on  the  other  hand,  receives  X(1)  from  its 
3(1).  This  indicates  that  it  has  lost  its  best  path  to  Node 
1.  As  with  Node  3,  when  a  node  discovers  that  its  besr  path 
to  d  is  broken,  it  freezes  any  data  traffic  in  its  buffer 
for  d,  and  issues  an  X-msg.  Therefore  Node  5  now  issues 
X(1)  to  Nodes  4  and  6.  Once  again  Node  4  ignores  the  X-msg. 
However  this  time  Node  6  has  received  the  X-msg  from  its 
3(1).  This  would  cause  Node  6  to  stop  sending  data  traffic 
until   a   new   best   path   is   found. 

At  the  User  Protocol  level,  which  may  employ  virtual 
links  as  described  in  Chapter  III,  the  X-msg  may  not  be 
enough   to   stop      all   traffic  routed   over    a  given      link   when    a 
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break  is  discovered.  A  virtual  linJc  fixes  a  route  at  the 
time  it  is  created,  for  the  duration  of  the  traffic  session. 
In  the  meantime,  subsequent  updaxe  cycles  may  have  caused 
nodes  along  an  established  virtual  link  to  select  other 
nodes  as  B  (d)  while  maintaining  its  virtual  link  thru  the 
node  which  was  the  B  (d)  at  the  time  the  virtual  link  was 
created.  Therefore,  in  addition  to  sending  X-msgs  ro  all 
neighbors  for  all  destinations  for  which  a  broken  link  was 
considered  a  best  path,  it  may  also  be  necessary  to  define  a 
Virtual  Disconnect  message  which  would  be  relayed  upstream 
to  break  down  virtual  links.  In  fact  something  like  this 
would  probably  be  required  in  any  network  using  virtual 
links  to  break  down  the  virtual  links  when  users  have 
completed  a  routine  traffic  session. 

Because  of  the  frequency  of  the  U-msg,  it  may  non  oe 
necessary  for  a  X-msg  to  work  its  way  all  the  way  upstream 
to  the  most  remote  node  on  the  best  path.  In  Fig.  4.9  Node 
2  could  have  issued  its  X(1)  after  Node  1  issued  [1(1,1,0)  ro 
Node  4.  In  this  case,  if  Node  4  had  not  yet  processed 
a  (1,1,0)  when  it  received  the  X(1)  from  its  B(1),  Node  4 
would  immediately  adopt  the  direct  link  as  its  B(1)  and 
issue  11(4,1,5)  to  Nodes  2,  3,   and  5.    Since  Node  2  already 
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a    Best    Path    link   to   node    1 


Pig,    4.9.      I-msg   fleets    U-msg 


froze  traffic  for  Node  1,  it  would  immediately  release  the 
traffic  to  Node  4  considering  Node  4  as  its  B(1) .  If  Node  3 
had  already  frozen  traffic  for  Node  1,  the  same  would  apply. 
But  in  this  situation  it  is  linJcely  thar  a  new  best  path 
would  be  established  before  traffic  in  Nodes  5  and  6  were 
even   affected   by   the   broken  link. 

New  links  do  not  have  the  traumatic  impact  of  broken 
links.  A  new  link  represents  the  addition  of  a  new  neighbor 
for  the  two  nodes  on  each  side  of  the  link.  Since  the  link 
is  initially  unloaded,  it  is  likely  to  become  a  prime 
candidate  for  a  link  in  several  best  paths  because  of  its 
low      channel     value.  It   is      necessary     to      guard     against 
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oscillations  here  which  can  be  done  by  assigning  arbitrary 
initial  average  channel  value  to  the  new  linlc  which  would 
enable  the  link  to  be  gracefully  integrated  into  tae 
network.  In  time,  as  the  link  becomes  used,  the  effect  of 
this  arbitrary  assignment  will  disappear.  Once  again, 
because  of  the  frequency  of  initiating  U-msgs,  there  is  no 
need  to  request  special  updates  upon  the  discovery  of  a  new 
link.  It  will  be  integrated  into  the  network  quickly  enough 
just  by  normal  updates. 

3 .   Alternate  Link  -  an  Interim  Fix 

It  is  not  always  necessary  to  stop  traffic  in  rhe 
face  of  a  broken  link.  Ideally  every  best  path  would  have  a 
backup  path  so  that  when  a  broken  link  is  discovered, 
traffic  is  immediately  switched  to  the  backup  path  with 
minimum  ripple  in  network  traffic  flow.  But  this  may  nor  be 
possible,  and  the  additional  complexity  in  the  protocol  as 
well  as  the  increase  in  the  volume  and  content  of  network 
management  messages  appears  significanr. 

However,  as  explained  in  Appendix  A,  the  protocol  as 
described  in  this  chapter  provides  sufficient  informarion  to 
manage  the  basic  update  and  broken  link  functions,  and  with 
a   slight  increase  in  processing   at  each   node,   the   same 
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network  management  messages  can  occasionally  provide  a 
real-time  routing  alternative  to  a  broken  link.  This  is 
called  an  alternate  link. 

The  alternate  link  is  identified  during  the  update 
operation.  For  example,  during  a  routine  Update  for  Node  1 
of  the  network  in  Fig.  4.10,  Node  2  will  send  a  (2, 1,2)  ro 
Nodes  3  and  U.  Node  4  will  not  select  Node  2  as  its  B(1) , 
and  would  normally  discard  the  U-msg.  However  if  Node  4 
made  one  additional  comparison,  it  may  still  find  the  Node  2 
route  to  Node  1  useful. 


\y 


Fig.  4.10.   The  Alternate  Link 


For  any  node  j,  by  comparing  the  cummulative  channel 
value  (D  (1)  )  of  the  last  relaying  node  (1)  with  node  j's 
current  cummulative  channel  value  along   its  besx  path  to  d. 
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node  j  can  determine  if  traffic  passing  thru  node  1  can  also 
eventually  pass  back  thru  node  j.  Assuming  all  links  have  a 
minimum  channel  value  >0,  if  node  j's  cummulative  best  path 
channel  value  >=  D  (1) ,  then  node  j  is  assured  that  node  1 
does  not  pass  traffic  thru  node  j  in  order  to  qez  to  d. 
This  minor  conclusion  provides  node  j  with  a  loop-free 
alternative  path  to  d  if  it  should  discover  a  break  in  its 
best  path.  This  alternative  says  nothing  about 
multi-destination  or  implied  loops.  It  only  offers  a 
temporary  fix  for  a  node  which  has  experienced  a  broken 
link. 

Going  back  to  the  example  in  Fig.  4.10,  Node  4  notes 
in  LJ{2, 1,2)  that  D(2)  =  2  which  also  equals  the  cummulative 
channel  value  for  Node  4' s  3(1)  .  This  causes  Node  4  to  iisr 
Node  2  as  an  alternate  link  to  Node  1.  In  larger  networks, 
one  node  can  certainly  have  alternate  links  for  several  d's 
as  well  as  several  alternate  links  for  a  single  d.  Node  3 
in  the  example  sets  3(1)  =  Node  2.  However  when  it  receives 
0(4,1,2),  it  will  list  Node  4  as  its  alternate  link  to  Node 
1.  Likewise  Node  2  will  pick  Node  4  as  its  alternate  link 
to  Node  1.  3ut  note  that  Node  4  can  not  rely  on  Node  3  as 
an  alternate  link.    When  Node  4  received  11(3,1,4)  from  Node 
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3,  it  has  no  way  of  insuring  that  the  route  is  not  as  shown 
in  Fig.  4.11.  Therefore  in  the  absence  of  any  further 
overhead  traffic.  Node  4  discards  this  information  as 
unreliable. 


Fig.  4.11.   Potential  Loop  Situation 


The  impact  of  alternate  links  is  not  clear.  If  a 
network  is  very  evenly  weighted  and  richly  connected,  sach 
node  could  have  one  or  lore  alternate  links  to  most  of  the 
other  nodes  in  the  network.  This  implies  that  broken  links 
njay  only  require  a  shift  in  traffic.  A  less  evenly 
distributed  network  would  have  some  nodes  with  alternate 
links  and  others  without.  In  this  case  some  X-msgs  might  be 
avoided,  others  curtailed,  and  yet  others  unaffected.  Az  a 
minimum,    the   alternate  link  concept   appears   to   add 
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additional  robustness  to  the  network.  At  best  it  may  allow 
the  Update  frequency  to  be  decreased,  cutting  down  the  rate 
of  management  traffic. 

D.   EXPANDING  TO  RELATED  GROUPS  AND  FAMILIES 

Although  there  is  no  theoretical  limit  on  the  number  of 
nodes  in  a  basic  group,  there  may  be  practical 
considerations  which  make  it  attractive  to  limit  this 
number.  For  example,  when  all  nodes  are  considered  part  of 
a  single  basic  group,  then  every  node  in  the  basic  group 
(which  includes  the  entire  network)  must  record  a  B (d)  for 
every  other  node  in  the  network.  This  further  implies  that 
updates  for  every  individual  node  can  potentially  span  the 
entire  network.  As  the  number  (N)  of  nodes  in  a  ricnly 
connected  network  grows,  the  number  of  U-msgs  generated  (to 
complete  an  update  for  one  source)  under  worst-case 
conditions  approaches  3  (N**2)  .  (See  Appendix  C)  .  Therefore 
it  may  be  convenient  to  partition  the  network  along 
operational  or  geographical  boundaries.  To  investigate 
this,  several  additional  definitions  must  be  introduced. 

1 .   yiore  Definitions 

In  the  top   half  of  Fig.   4.12,   all  the   nodes  in  a 
given  network  fail  into  one  of  six  groups  numbered  1Q0  thru 
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600.  Modes  within  a  particular  groap  consider  rhat.  group 
its  basic  group.  Within  a  basic  group  each  node  has  a 
unique  node  identity.  For  example,  in  Group  UOO,  there  is 
only  one  Node  2.  Outside  of  a  node's  basic  group  are  other 
groups.  For  each  group  in  the  top  of  Fig.  4.12,  there  are 
five  other  groups  called  Related  Groups.  Note  that  related 
does  not  imply  that  two  grpups  have  a  common  border.  For 
example.  Group  400  does  not  border  Group  200.  By  combining 
the  group  and  node  identity,  each  node  can,  once  again,  have 
a  unique  identity  in  the  networJc.  For  example.  Node  2  in 
group  400  can  uniquely  be  called  Node  402. 

Furthermore,  the  six  groups  in  the  top  of  Fig.  4.12 
can  be  grouped  together  and  called  a  Family.  This  family 
could  also  have  a  unique  identity,  such  as  3000  in  Fig. 
4.12,  and  be  one  of  a  number  of  families  which  combine  to 
form  a  large  network  of  nodes.  In  the  bottom  of  Fig.  4. 12, 
there  are  four  families  numbered  1000  through  4000.  Once 
again,  every  group,  in  every  family  in  the  bottom  of  Fig. 
4.12  could  have  a  Node  2.  3ut  when  group  and  family 
identities  are  added  to  the  node  identity,  each  node  retains 
a  unique  identity.  To  fully  identify  Node  2  mentioned 
earlier,   it   can  now  be  called   Node  3402.    By   using  this 
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Fig,  4.12.   Related  Groups  and  Faailies 
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three  tier  identity  concept,  tiiere  is  a  potential  to  reduce 
network  management  traffic.  There  is  no  requirement  to  stop 
at  three  tiers;  however  three  tiers  suffice  to  demonstrate 
the  principles. 

One  requirement  of  this  structuring  principle  is 
that  groups  and  families  must  retain  some  continuity.  That 
does  not  mean  that  groups  and  families  cannot  move  in 
relation  to  each  other.  It  simply  means  that  entire  groups 
and  families  can  not  distribute  all  their  nodes  randomly 
around  the  network.  If  the  network  must  tolerate  complete 
random  node  movement,  then  the  single  basic  group  concept 
seems  best  suited  to  control  the  network.  However  there  may 
be  several  situations  wherein  clusters  of  nodes  are  likely 
to  remain  geographically  and  operationally  close  while  being 
fluid  in  a  larger  network  of  nodes.  military  organizations 
are  a  good  example  of  this  structuring. 
2.   5f f icigncies  of  Grouping 

In  the  remainder  of  this  study,  any  reference  to 
node  identity  will  imply  the  full  identity  including  the 
node* s  basic  group  and  family,  if  applicable.  All  message 
formats  and  contents  are  also  the  same.  It  will  be  assumed 
that  all  nodes  know  their  assigned   group  and  family.    In  a 
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military  network  for  example,  the  group  could  represent  the 
battalion,  and  the  family  could  represent  the  Brigade. 

As  shown  in  Fig.  4..  12,  individual  nodes  continue  to 
establish  links  with  neighboring  nodes  regardless  of 
arbitrary  boundaries.  Efficiency  is  available  by  changing 
the  processing  of  messages  that  cross  these  boundaries.  The 
goal  is  to  reduce  the  number  of  network  management  messages 
that  travel  to  remote  nodes  in  the  network  when  there  is 
small  likelihood  that  the  best  paths  being  updated  by  these 
messages  will  ever  be  used. 

Basic  groups  are  organized  to  contain  a  group  of 
nodes  which  communicate  frequently  with  each  other.  Every 
node  in  the  basic  group  has  a  best  path  to  every  other  node 
in  the  basic  group.  For  these  nodes,  which  constitute  a 
mini-network,  the  basic  network  management  protocol 
described  in  Section  C  above  applies  directly.  However,  the 
node  to  node  protocol  will  establish  a  link  with  any  node  it 
can  contact.  Therefore  a  node  may  find  that  it  has  a  link 
with  another  node  outside  of  its  basic  group.  This  is  where 
group/family  processing  begins. 

Fundamentally,  grouping  causes  nodes  to  treat 
related  groups  and  related  families   as  single  nodes,   while 
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still  raaiataining  the  capability  to  contact  each  node  in  the 
networlc.  Therefore  for  our  example  in  Fig.  U.  12,  Node  3402 
has  two  other  nodes  in  its  Jaasic  group,  five  related  groups, 
and  three  related  families.  Thus  Node  3402  maintains  a  best 
path  to  a  total  of  10  networic  elements.  3y  contrast, 
without  groups  Node  3402  would  be  required  to  maintain  best 
paths  to  57  individual  nodes  in  order  to  contact  every  node 
in  the  networlc.  It  should  be  noted  thar  basic  groups  of 
only  three  nodes  is  probably  unrealistic.  Basic  groups  of 
10  to  25  nodes,  families  of  3  xo  5  groups  and  networks  of  3 
to  5  families  would  fit  rypical  military  organizations. 
Although  there  is  probably  an  optimum  combination  for  a 
given  traffic  profile,  there  are  no  rigid  requirements  on 
grouping  sizes. 

During  the  course  of  a  normal  Update,  an  initiating 
node,  or  a  relaying  node  ^ill  send  a  Q-msg  to  all  of  its 
neighbors.  The  receiving  node  (j)  checks  the  identity  (1) 
of  the  node  which  last  relayed  the  U(l,d,D(l))  message.  If 
1  is  not  in  Node  j«s  basic  group,  and  if  1  does  not  equal  d 
(indicating  the  last  relaying  node  did  not  initiate  the 
message).  Node  j  discards  the  U-msg.  If  l=d,  this  indicates 
to  Node  j   that  a  neighbor  outside  Node  j's   basic  group  has 
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initiated  an  Update.  If  the  neighbor  is  from  a  related 
group  (same  family)  ,  Node  j  compares  it$  cumraalative  best. 
path  channel  value  for  that  related  group  to  the  net  channel 
value  through  1.  If  this  is  an  improvement.  Node  j  alters 
the  U-msg  with  its  d(i,l)',  and  relays  the  U-msg  to  all 
neighbors.  This  procedure  continues  until  this  U-msg  can 
not  offer  an  improved  best  path  to  any  other  node  or  until 
it    reaches    the   family  boundary.  If    Node   j*s   previous   best 

path  was  superior  to  the  new  possibility.  Node  j  would 
discard     the   U-msg.  If    the      neighboring      node    (1)         which 

initiated  the  message  was  from  another  family,  node  j  would 
check  its  current  cummulative  best  path  channel  value  to  i's 
family,  and  compare  it  to  the  net  channel  value  through  1. 
As  in  the  case  of  a  related  group,  if  there  is  an 
improvement,  the  U-msg  is  relayed,  otherwise  it  is 
discarded. 

Fig.  4.13  serves  to  illustrate  Updates  across 
boundaries.  The  process  may  become  clearer  by  tracking  a 
possible  sequence  of  events  during  a  routine  update 
operation.  In  Fig.  u.l3,  the  dotted  triangles  pointing  away 
from  a  node  represent  that  node's  (pre-update)  best  path  to 
a   related      family    (if   the    U-msg      creating  the  best      path   had 
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Update  initiated  by  Node  13  01 


i- 


PREVIOUS    Best    Path 


•BP    after    Uodare 


Fig.    4. 13,      Update  Across  Boundaries    (partial    network) 


crossed  a  family  boundary  after  being  initiated)  or  best 
path  to  a  related  group  (if  the  U-msg  creating  the  best  path 
had  crossed  a  related  group  boundary  after  being  initiated) . 
The  dark  triangle  represents  the  updated  best  paths  after 
Node    1301    issues   an    update. 

When  Node  1301  issues  a  U-msg  to  all  of  its 
neighbors,  the  nodes  in  basic  group  1300  will  update  like 
any   basic      group.        Nodes      1203    and      2202   vill      also   receive 
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11(1301,1301,0).  Node      1203      sees        that      this      a-msg      vas 

initiated  by  one  of  its  related  group  neighbors,  and  after 
comparing  channel  values  with  its  old  best  path  through  Node 
1202,  selects  Node  1301  as  its  new  best  path  to  Group  1300 
(or  B(1300)=Node  1301).  This  also  requires  Node  1203  to 
adjust  and  relay  the  U-msg  to  all  of  its  neighbors.  Node 
2102  receives  Node  1203»s  O-msg  across  a  family  boundary, 
notes  that  it  was  relayed  but  not  initiated  by  Node  1203, 
and   discards    it.  It    is    discarded   because     this   particular 

version  of  Node  1301  's  four  original  update  messages  (one 
for  each  link)  initially  crossed  a  Group  boundary. 
Therefore  all  subsequent  versions  of  this  U-msg  serve  to 
update  best  paths  to  Group  1300  within  its  family. 
Therefore  when  Node  1203  relayed  an  offspring  of  the  "group" 
version  outside  its  family.  Node  2102  discarded  it.  Node 
1202  Iceeps  its  best  path  to  Group  1300  through  Node  1303. 
Node  1201  changes  its  best  path  through  Node  1203  and  relays 
the  U-rasg    to   its   neighbors. 

Now  Node  1103  notes  that  a  Group  1200  node  has 
relayed  an  U-msg  initiated  by  a  third  related  group  in  Node 
1103*s  family;  therefore  it  will  evaluate  this  message  in  an 
effort   to    improve   its   path   to   Group    1300.         Note    that   once    a 
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a-msg  successfully  crosses  a  group  boundary  leaving  its 
basic  group,  it  continues  to  cross  other  group  boundaries 
until  it  no  longer  offers  a  shorter  best  path,  and  is 
discarded. 

The  same  considerations  apply  when  initially 
crossing  a  family  boundary,  as  will  be  seen  below.  Node 
1103  updates  its  best  path  to  Group  1300  and  relays  the 
a-msg  to  Nodes  1101  and  3102.  Node  110  1  retains  its  path  to 
Group  1300  through  Node  1103.  It  so  happens  that  Node  3102 
currently  has  Node  1103  as  its  best  path  to  the  1000  Family. 
However  when  it  receives  the  U-msg  relayed  by  Node  1103,  it 
notes  that  it  was  not  initiated  by  Node  1103  and  discards  ir 
since  Node  3102  is  net  interested  in  establishing  a  path  to 
Group  1300,  or  any  other  individual  group  in  zae  1000 
Family, 

Meanwhile  Node  220.2  has  also  received  the  U-msg 
initiated  by  Node  1301.  Node  2202  updates  its  net  channel 
value  retaining  this  best  path,  and  relays 
a  (2202, 1301, D  (2202) )  to  all  of  its  neighbors.  Node  2102 
accepts  this  new  route  as  its  best  path  to  the  1000  Family 
in  preference  to  its  less  efficient  link  through  Node  1203. 
It  then  relays  the  0-msg  to  its  neighbors.  Node  2101 
updates  and  relays  again. 
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Now  Node  3102  has  again  received  a  version  of  the 
U-msg  initiated  by  Node  130)1.  But  this  time  it  was  passed 
by  a  node  which  was  not  in  the  1000  Family,  indicating  that 
the  cummulative  channel  value  in  the  U-msg  up  to  rhis  point 
represents  the  distance  along  this  proposed  path  to  the  edge 
of  the  1000  Family.  Node  3102  compares  this  to  its  current 
best  path  channel  value  to  the  1000  Family  (which  is  direct. 
to  Node  1103),  and  picks  the  best  path.  In  this  example. 
Node  3102  found  that  it  was  more  efficient  to  travel  to  the 
1000  Family  through  the  2000  Family,  than  to  cross  the 
direct   link   to   Node    1103    (rather   unusual). 

To  use  this  routing  information,  the  Source  node 
addresses  traffic  to  the  destination  node  and  sends  the 
traffic  on  its  way.  If  the  destination  is  in  the  same  basic 
group  as  the  source,  the  source  has  a  best  path  direct  to 
the  destination    node.  If   the   destination    is      in   a   related 

group  (same  Family) ,  the  source  node  sends  the  traffic  on 
the  best  path  tc  the  destination  node's  basic  group.  As 
soon  as  it  crosses  the  basic  group  boundary,  the  traffic 
will  reach  a  node  which  now  has  a  best  path  to  the  specific 
destination  node.  Similarly  for  inter-family  traffic:  it  is 
routed  on   the      source   node's   best    path    to   the      family   of   the 
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destination.  When  it  cresses  the  family  boundary,  it  is 
routed  by  the  destination's  group  and  finally  when  it 
crosses  the  basic  group  boundary,  it  is  routed  to  the 
specific  node. 

The  cost  in  routing  inefficiency  entailed  by  the 
tremendous  reduction  in  overhead  traffic  offered  by  this 
scheme  is  obvious  from  the  example  in  Fig.  4.13.  If  Node 
3102  wanted  to  communicate  with  Node  1101  after  the  Node 
1301  update  (darlc  triangles),  the  traffic  would  ultimately 
travel  through  nearly  every  node  in  the  figure,  when  if  fact 
Node  1101  is  only  two  links  away  from  Node  3102.  Although 
it  has  been  established  that  it  is  shorter  to  go  from  Node 
3102  to  Node  1301  than  to  Node  1103  in  this  case,  the  full 
trip  would  normally  be  shorter  by  the  more  direct  route. 

Besides  the  reduction  in  overhead  traffic,  it  should 
also  be  noted  that  group  and  family  boundaries  would 
normally  be  selected  on  operational  boundaries,  so  that  a 
relatively  small  amount  of  traffic  would  be  expected  to 
suffer  from  this  self-inflicted  inefficiency. 

There  are  some  minor  exceptions  to  the  above  rules 
which  would  be  helpful  if  integrated  into  this  scheme.  for 
example,   any  node  on  a  boundary  with  a  non-best  path  direct 
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link  to  a  node  in  another  group  or  family,  need  not  reject 
or  purposely  break  this  link  simply  because  it  is  programmed 
only  to  use  that  node's  group  or  family  address.  The  minor 
additional  overhead  of  retaining  dirac-::  links  to  all 
neighboring  nodes  can  be  useful  in  recovering  from  broken 
links.  Both  the  broken  path  and  alternate  link  concepts 
described  for  the  basic  group  can  be  applied,  virtually 
unchanged,  to  the  group/family  processing  concept. 


"^  3.est  Path 
^Channel  Value 


Figure  4.14.   Broken  Paths  and  Alternate  Links  Across  3oan- 
daries 

A  broken  link   on  a  best  path  to  a   related  group  or 

family   causes  the   discovering  node  to  first   look  for   an 
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alternate  link.  In  Fig.  4.14,  a  portion  of  a  network 
including  boundary  crossings  and  link  channel  values  is 
shown.  If  these  channel  values  had  existed  whan  Node  1203 
last  updated.  Node  2102  would  have  retained  its  B(1000)=Node 
1203.  However  when  Node  2202  relayed  U  (2202, 130 1 ,3)  to  Node 
2102,  Node  2102  would  see  that  D (2202) =3  to  the  1000  Family, 
which  is  less  than  its  cummulative  best  path  channel  value 
to  the  1000  Family.  Therefore  Node  2102  would  keep  Node 
2202  as  an  alternate  link  to  the  1000  Family.  Then  if  Node 
2102  lost  its  direct  link  to  t.he  1000  Family,  it  could 
immediately  switch  traffic  to  Node  2202  with  the  assurance 
that  traffic  would  not  enter  a  loop.  Conversely,  Node  2202 
could  not  pick  up  Node  2102  as  its  alternate  link  to  the 
1000  Family  because  Node  2102's  cummulative  channel  value 
(4)  is  greater  than  Node  2202* s  cummulative  channel  value 
(3)  . 

If  Node  2202  experienced  a  broken  link  to  the  1000 
Family  in  Fig.  4,14,  it  would  be  required  to  initiate  a 
broken  path  message  to  all  of  its  neighbors.  When  Node  2102 
received  X  (1000)  frcm  Node  2202,  it  would  disregard  the 
X-msg  since  its  best  path  is  not  affected.  When  Node  2204 
received  X(1000),   it  would  find  that  its  3(1000)=  Node  2202 
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indicating  it  had  lost  its  best  path  to  the  1000  Family,  and 
look  for  an  alternate  link.  If  during  rhe  last  update  by 
Node    1203    the   channel   value  b   in    Fig.    4.14   were   such    rhat 

b    *    Node    2202«s    D(1000)     >=    Node    2102«s   D(1000) 

or 

b   +    3   >=   4, 

then  Node  2204  would  switch  traffic  for  the  1000  Family  thru 
Node    2102.      If 

b   +    3   <    4, 

then  Node  2204   would  relay  the  X-msg  or  X(1000)    to  all  of 

its  neighbors.  And  the  process  would  continue  outward  from 
the  broken  link  just  as  within  a  basic  group. 

In  this  discussion,  it  should  be  noted  that  the 
basic  group  concept  of  network  management  protocol  can  be 
applied  directly  to  the  group/family  organization  of  the 
nexwork,  with  seme  reguirements  on  the  structure  of  the 
group  and  families.  The  idea  of  detached  nodes  in  the 
group/family  concept  is  a  special  case  which  will  be 
discussed  in  Chapter  ?I.  Whether  or  not  the  group/family 
concept  should   be  imposed  on  the   network  is  a   function  of 
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networic      size,        the      user   traffic      profile      and      efficiency 
tradeoffs. 
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V.   SIMULATION 

A  primary  objective  of  the  simulation  was  to  test  the 
basic  algorithm  by  selecting  and  fixing  some  network 
parameters,  and  then  making  mulriple  runs  in  which  the 
remaining  parameters  were  varied.  Though  limited  in  scope, 
the  simulations  validated  some  of  the  mechanics  of  the 
algorithm.  This  included  originating  and  relaying  update 
messages,  which  further  resulted  in  selecting  and  updating 
best  paths  based  on  calculated  channel  values.  Both  the 
basic  group  and  family/group  concepts  were  tested.  Two 
methods  of  calculating  channel  values,  both  using  a  variable 
time  duration  called  a  window,  were  also  investigated.  The 
test  network  is  shown  in  Fig.  5.1. 

Simulation  results  were  initially  compared  to  results 
obtained  using  static  routing  via  fewest  number  of  hops  over 
the  same  network.  Later,  selected  parameters  were  varied  zo 
observe  the  stability  and  robustness  of  the  network  control. 
As  a  result,  several  basic  observations  were  made  about  the 
attributes,  efficiencies  and  limitations  of  this  management, 
protocol  concept. 

The  broken  link  and  alternate  link  concepts  were  not 
part  of   this   initial   simulation.     If   the   basic   link 
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family  boundary 
group  boundary 


Fig.  5. 1,   Test  Network 


management  concept   ultimately  proves  to  be   worthwhile,   as 

these  initial  tests  suggest,    then  the  next  logical  step 

would  be   to  test   the  algorithm  under   the  added  strain  of 

gaining  and  losing  links. 
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The  simulation  was  conducted  using  the  SIMSCRIPI  II. 5 
simulation  language.  The  encoded  algorithm  is  listed  in 
Appendix  E.  Several  SIMSCBIPT  encoding  decisions  are 
discussed  later  in  this  chapter. 

A.   SinaiATING  A  USEE  AND  aEASUBING  EFFECTIVENESS 

In  order  to  observe  and  measure  the  relative 
effectiveness  of  the  algorithm,  a  simple  user  service 
protocol  involving  only  data  packets  was  integrated  into  the 
system.  User  traffic  sessions  were  generated  with  an 
exponentially  random  inter-arrival  rate  and  with  a  uniformly 
random  number  of  packets.  Both  the  rate  and  number  of 
packets  were  controlled  by  input  variables.  A  packet  either 
moved  thru  the  network,  or  waited  in  a  queue  if  the  required 
link  was  busy,  until  it  arrived  at  its  destination  where  it 
was  discarded  after  performance  data  was  collected.  All 
traffic  sessions  (and  therefore  all  packets)  had  a  source 
node  determined  by  a  uniform  random  function  based  on  a 
transmit  factor  assigned  to  each  node.  Each  packet  also  had 
a  destination  assigned  by  a  similar  process.  Packets 
created  in  a  single  traffic  session  all  had  the  same  source 
and  destination. 
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One  measure  of  relative  efficiency  was  the  average  time 
(per  total  nodes  hopped)  it  took  packets  to  reach  their 
destination.  Other,  perhaps  more  significant,  measures  of 
effectiveness  involve  the-  amount  of  queuing  delay  or  queue 
sizes  that  occurred  during  the  test.  This  was  observed  in 
several  ways. 

The  maximum  queue  size  per  simulation  was  recorded  for 
every  link  and  listed  after  every  run.  This  information 
varied  significantly  and  appeared  to  be  influenced  by  the 
large  influx  of  packets  during  the  initiation  of  traffic 
sessions. 

Half  way  thru  the  simulation,  a  group  of  links  having 
the  longest  queues  during  the  first  half  of  the  test  were 
selected  to  be  sampled  during  the  second  half  of  the  test. 
The  number  of  links  selected  was  an  input  variable.  The 
number  of  samples  per  links  was  also  an  input  variable,  but 
was  normally  set  at  1000.  The  resulting  distribution  of 
sample  sizes  for  the  busiest  links  in  the  network,  appeared 
to  offer  a  stable,  more  representative  measure  of  the 
algorithm's  ability  to  process  packets.  The  average  sample 
queue  size  and  its  standard  deviation  was  also  calculated. 
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other  checks  and  measures  included  the  average  number 
of  nodes  hopped  per  packet,  the  average  number  of  links  used 
for  a  node^s  update  cycle,  and  the  longest  he3z  path 
established  anytime  during  the  test.  Finally  there  are 
several  checks  to  report  if  packets  were  excessively 
delayed,  particularly  due  to  dynamical  changes  in  best  paths 
during  message  transmission.,  resulting  in  an  abnormal  number 
of  hops  to  the  destination. 

3.   PROGRAMMING  SCHEME 

The  simulation  program  was  organized  as  a  set  of 
subroutines  controlled  by  a  simulation  clock  (Eig.  5.2) 
which  is  an  inherent  feature  of  SIMSCRIPT.  Before  the 
simulation  begins,  the  routine  is  initialized  by  the  main 
program  which  includes  reading  input  variables,  dimensioning 
arrays  and  printing  out  various  input  parameters.  The  main 
program  also  schedules  the  events  on  the  simulatj.on  clock 
which  starts  several  activity  chains  resulting  in  the 
generation  of  user  traffic,  the  periodic  update  of  the 
network  and  the  collection  of  performance  data. 

The  clain'  program  schedules  the  first  update  or:Lginated 
by  each  node  in  the  network*  This  is  begun  at  a  random  time 
thru  an   event  routine  called  NEW. UPDATE. MESSAGE.    Eor  the 


95 


Initialize 

(MAIN) 


Originate 
an  Update 

(NEW.  UPDATE, 
MESSAGE) 


Update 
Arrives 
(AREHVAL. 
MESSAGE) 


Update 
Continues 
(CONT. UPDATE, 
MESSAGE) 


Calculate 
Channel 
Values 
(CV. LATCH) 


Determine 
Sample 
Size 

(QU.  SAMPLER) 


Print  Interim 
and  Final 

Reports 
(STOP. 

SIMULATION) 


Conduct  a 
Sample 
(SAMPLE) 


Originate  a 
Traffic 

Session 
(NEW. PACKET, 

MESSAGE) 


Packet 
Continues 
(CON. PACKET. 
MESSAGE) 


Packet 
Arrives 
(ARIVE. PACKET) 


Packet 
Completes 

Trip 
(COMPLETED. TRIP) 


L 

T 

N 
K 


U 

■c 

1-1 

u 

r 

s 


Fig.    5.2.      Prograa  Organization 


designated  node,  this  routine  generates  a  U-rasg  for  each  of 
its  neighbors  and  places  the  messages  on  "che  link  to  each 
neighbor.        The    routine   schedules   the      arrival    of   each    U-msg 
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after  a  pause  to  account  for  propagation  time  plus  message 
duration.  k  time  of  2ms  was  selected  for  the  simulation. 
Finally  this  routine  reschedules  the  designated  node  for  its 
next  update  origination  in  an  interval  which  was  based  on  an 
input   variable   explained   below. 

Once  a  U-msg  was  originated,  it  was  scheduled  to  arrive 
at  neighboring  nodes.  The  arrival  of  a  Q-msg  was  handled  by 
a  routine  called  ARRIVAL. MESSAGE.  This  routine  is  tae  heart 
of  the  update  operation  and  implements  the  update  portion  of 
the  algorithm  in  Chapter  IV.  The  ARRIVAL. MESSAGE  routine 
determines  whether  or  not  this  U-msg  should  be  relayed  to 
the  neighbors  of  the  receiving  node,  which  neighbors  to 
relay  it  to,  and  what  the  contents  of  the  relayed  message 
will   be.  It   simulates   the      processing   time      by   scheduling 

retransmitted  U-msgs  to  continue  after  a  brief  processing 
time.  U-msg  processing  time  was  set  at  0.1  x.  the  packet 
processing  time  (.0001  sec)  to  reflect  the  priority  of 
U-msgs   and   their    small   relative   size. 

After  the  processing  time,  the  U-msg  is  placed  on  the 
next  link  by  the  CONT.  UPDATE.  ilSSSAGS  routine  and  the  U-msg 
is  again  scheduled  to  arrive  at  the  next  node  in  the 
selected   transmission   time    of      2ms.         This   process   continues 
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until  tha  O-msg  arrives  at  a  node,  is  processed  by  the 
ARRIVAL. MESSAGE  routine  and  considered  no  longer  suitable 
for  retransmission  (due  to  an  excessive  net  channel  value) . 
The  result  is  the  creation  of  a  best  path  to  the  node  (group 
or  family)  which  originated  the  U-msg  from  every  other  node 
thru  which  the  message  successfully  passed  prior  to  discard. 
During  the  course  of  the  simulation,  as  link  queues  vary 
in  size,  channel  values  change.  One  of  the  most  significant 
observations  affecting  the  fundamental  algorithm  made  during 
the  simulations,  concerns  the  timing  of  when  channel  values 
may  be  calculated.  It  was  initially  conceived  that  during 
an  update  cycle,  a  node  could  calculate  its  channel  value  to 
a  neighbor  whenever  that  node  received  a  0-msg  from  that 
neighbor.  However  it  was  found  that  under  a  relatively  high 
traffic  rate,  some  node  (i)  might  relay  a-msgs  having 
selected  a  best  path  node  ( j)  ,  but  by  the  time  node  i 
received  relayed  versions  of  its  own  U-msg  its  channel  value 
to  node  j  might  have  changed  dramatically,  resulting  in  a 
loop  (See  Fig.  5.3) .  To  remedy  this  problem,  updates  were 
constrained  to  start  anytime  daring  a  (relatively  large) 
time  interval.  This  interval  was  followed  by  another  equal 
size   interval   during    which    no    updates   could    be   started,      but 
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existing  updares  could  be  processed.  The  minimum  size  of 
these  intervals  was  large  enough  to  insure  that  any  existing 
update  cycles  would  work  their  way  out  of  the  networic  before 
the  next  series  of  updates  was  allowed  to  begin.  The 
calculation  of  channel  values  was  synchronized  in  each  node 
to  take  place  once  (and  only  once)  near  the  beginning  of  the 
first  (origination)  interval.  The  operational  feasibility 
of  this  synchronization  requirement  is  not  unreasonable,  for 
very  good  network  synchronization  will  be  a  likely 
requirement  in  order  to  take  advantage  of  the  benefits  of 
spread  spectrum  modulation  techniques,  position  location  or 
other  attractive  capabilities  of  digital  communication. 

In  the  simulation,  the  Main  program  schedules  the  first 
channel  value  calculation  with  the  routine  C7. LATCH.  Since 
this  takes  place  at  time  zero  of  the  simulation  and  no 
traffic  has  started,  all  links  are  initialized  to  the  basic 
channel  value  of  1.  CV. LATCH  also  calculates  the  update 
origination  interval,  based  on  the  specified  update  interval 
which  is  an  input  variable  (OP. DATE .PERIOD) ,  and  reschedules 
itself  for  every  node  in  the  network. 

After  the  firsx  update,  the  CV. LATCH  routine  uses 
historical  queue   information  for  each   link  to   calculate  a 
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Fig.  5.3.   Possible  Result  of  Frequent  CV  Changes 


new  channel  value  for  thax  link.  This  value  is  based  on  a 
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summed  for  all  queue  measurements   not  older  than  the  WliJDOH 
for  a  given  link. 

The  Main  program  begins  to  schedule  traffic  with  an 
exponential  arrival  rate  based  on  an  input  variable 
(AVE. NEW. TRAFFIC. INTS3VAL) .  Traffic  is  started  by  calling  a 
routine  called  NEW. PACKET. MESSAGE.  The  first  traffic  is 
generated  after  the  networX  is  allowed  to  complete  one 
update  cycle,  thus  insuring  that  all  nodes  have  a  best  path 
to  the  other  nodes,  groups  or  families  as  appropriate.  A 
traffic  message  (referred  to  as  "session"  in  Appendix  E) 
involves  randomly  selecxing  a  source  node,  destination  node 
and  the  number  of  packets  in  the  message.  The  selection  of 
the  nodes  is  a  function  of  input  variables  assigned  to  each 
node  which  dictate  the  relative  frequency  with  which  nodes 
will  transmit  and  receive.  The  routine  can  also  restrict 
destination  nodes  to  ne  in  the  same  group  or  family  as  the 
source  node  for  a  given  percentage  of  the  traffic  messages 
(sessions)  based  on  additional  input  data.  The  routine  will 
send  the  first  packet  on  the  best  path  to  its  destination  if 
the  link  is  idle.  If  not  it  will  place  the  packet  in  a  link 
queue.  In  either  case,  all  other  packats  in  the  message  are 
placed  in  the  queue. 
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when  a  packet:  leaves  its  source  node,  it  is  assigned  the 
current  simulation  time  which  is  checked  again  upon  arrival 
at  the  packet's  destination.  This  information  is  used  to 
compute  the  average  and  peak  times  for  packets  to  hop  N 
nodes.  Each  packet  counts  the  hops  or  nodes  it  passes  thru 
anrouta  to  its  destination  as  explained  later  in  this 
section. 

When  a  packet  leaves  for  its  first  best  path  neighbor, 
±z  is  scheduled  tc  arrive  after  an  interval  representing  the 
packet  transmission  time,  which  is  an  input  variable  called 
PKT. XMN.TIME.  For  the  simulation  this  value  was  fixed  at 
50ras,  based  on  performance  factors  mentioned  in  Chapter  III. 

Finally  NEW . PACKET. ME3SAG5  reschedules  itself  for  the 
next  traffic  session  which  will  have  the  same  exponential 
inter-arrival  rate  mentioned  above,  but  will  result  in  the 
random  selection  of  a  new  source,  destination  and  message 
size  (number  of  packets)  . 

Enroute  to  their  destination,  packets  arrive  at 
neighboring  nodes  which  is  simulated  in  the  AHIVE. PACKET 
routine.  In  this  routine  a  packet  is  checked  to  see  if  it 
has  reached  its  destination.  If  so  it  is  processed  in  a 
routine  called  COMPLETED. TRIP  discussed   below.    If  not  the 
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packet  is  processed;  routed  to  the  next  best  path  neighbor 
based  on  the  ID  of  the  family,  group  or  node  of  the 
destination  node;  and  then  either  forwarded  if  the  link  is 
idle,  or  placed  in  the  link's  queue.  ARI7E. PACKET  schedules 
each  arriving  packet  thru  the  CON, PACKET  routine  after  a 
processing  time  delay  which  was  a  test  parameter  fixed  at 
O.lmsec  per  packer.  Finally  AHIVE, PACKET  goes  back  to  the 
queue  of  the  node  which  sent  the  last  packet.  If  another 
packet  is  in  the  queue,  ir  is  placed  on  ~he  link  (by 
scheduling  an  ARIVE. PACKET  for  that  packet)  to  the  node 
which  just  received  the  last  packet.  If  the  queue  was 
eoapty,    it    is   designated   as   idle. 

Meanwhile,  when  the  packet  scheduled  for  the  CON. PACKET 
routine  arrives,  if  the  link  to  its  next  node  is  idle,  ix  is 
placed  on  the  link  and  scheduled  zo  arrive  (ARIVE .PACKET)  at 
the  next  node  in  the  packet  transmission  time  (PKT.xaN. TIME) 
mentioned  above.  If  not,  it  is  placed  in  the  queue  for  that 
link.  In  order  to  minimize  large-scale  loading  shifts  from 
one  link  to  another,  the  algorithm  does  not  change  the 
routing  of  a  packet  coming  out  of  a  queue  to  be  transmitted 
if,  during  the  time  the  packet  was  waiting  in  the  queue,  the 
best   path   to      its   destination   has   changed.  A    packet    keeps 
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its  criginal  routing  unless  the  link  has  be«?n  broken  (not 
covered  in  these  simulations)  and  newly  arriving  packets  are 
routed  thru  the  best  path  node. 

Eventually  the  packet  reaches  its  destination.  Here  it 
is  processed  by  the  COMPLETED. TRIP  routine.  This  routine 
collects  and  computes  performance  data  including  the  number 
of  nodes  hopped  by  the  packet,  and  trip  time.  It  increments 
a  counter  which  sums  the  number  of  packets  hopping  N  nodes 
and  records  the  highest  trip  time  for  N  nodes.  It  keeps 
track  of  the  number  of  packets  arriving  for  each  session  and 
sums  all  the  trip  times  for  N  nodes  so  it  can  later  be 
divided  by  the  total  number  of  nodes  making  N  hops  to 
calculate  the  average  trip  time  for  N  hops. 

After  four  equal  intervals  (quarters) ,  the  simulation  is 
stopped  with  the  STOP. SIMULATION  routine.  This  routine 
reprints  selected  input  data.  It  also  calculates  and/or 
prints  performance  data  for  the  simulation  up  to  that  point. 
Appendix  S  contains  an  example  of  the  full  printout  which 
includes  the  average  and  peak  packet  transit  time  for  N 
hops,  and  the  maximum  queue  for  every  link.  Iz  also 
presents  results  of  a  statistical  sampling  of  the  links  with 
the  largest  maximum  queues  during  the  first  half  of  the 
simulation , 
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The  Hain  program  schedules  the  QU. SAMPLES  routine  at  the 
mid-point  of  the  simulation.  This  routine  will  identify  the 
M  links  with  the  highest  queues  in  the  first  half  of  the 
simulation.  M  is  an  input  variable  (SMP. LINKS)  .  QU. SAMPLER 
then  schedules  a  routine  called  SAMPLE  which  samples  these  M 
links  in  the  second  half  of  xhe  simulation  with  an 
exponentially  distributed  time  between  samples  with  mean 
1/S,  where  S  is  another  input  variable  (NO. OF. SAMPLES) .  The 
queue  sizes  found  during  these  samples  increment  a  queue 
size  counting  array  called  QO.DISTH.  STOP. SIMULATION  prints 
the  results  of  this  queue  sample  (QO.DISTR)  as  well  as 
calculates  the  average  queue  size  and  its  standard 
deviation.  After  four  reports  STOP. SIMULATION  halts  the 
test. 

C.   ARRAYS  AND  TEMPORARY  ENTITIES 

SIMSCRIPT  is  an  excellent  programming  language, 
particularly  for  its  readability  and  simulation  oriented 
functions.  The  encoded  algorithm  and  relaxed  routines  in 
Appendix  E  are  written  in  SIMSCRIPT  and  also  have  additional 
documentation.  However  the  organization  of  the  arrays  and 
attributes  of  the  "message"  and  "pack"  temporary  entities 
contain    several     subjective    encoding     decisions. 


105 


anderstanding  these  organizational  decisions  will  help  when 
reading  Appendix  E. 

The  arrays  used  in  the  program  are  listed  in  Fig.  5.4 
There  are  one,  two  and  three  dimensional  arrays 
(1-D,2-D,3-D) .  The  array  name  is  followed  by  its 
dimension (s) ,  which  may  either  be  variable  or  constant,  and 
by  the  different  meanings  for  the  subscripted  variable  (e.g. 
node  ID).  Below  each  array  name  is  the  meaning  of  the  first 
(1-D) ,  second  (2-D)  or  third  (3-D)  subscript.  Together  the 
subscripts  identify  a  variable  location  which  may  be  used 
during  the  simulation. 

?or  example,  the  first  array  (FAM.OF.GE?)  is 
1-dimensional.  Its  size  is  the  sum  of  the  number  of  nodes, 
plus  the  number  of  groups  plus  25.  Arguments  of  this  array 
will  be  the  program  numbers  for  groups  (program  numbers  are 
explained  in  Appendix  E) .  The  content  of  this  subscripted 
variable  is  the  family  of  the  group  in  the  argument. 

The  2  and  3  dimensional  arrays  are  read  similarly.  For 
example  SMP.SET  is  a  2-dimensional  array.  The  first 
argument  is  the  count  number  of  the  link  to  be  sampled  which 
is  determined  by  the  QQ. SAMPLES  routine.  The  second 
argument   identifies  whether  the  variable   is   the  "to"   or 
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1-D 

FAM.OF.GRP    (no.    of    nodes-*-   gcps-*-    25)    — '>    family    ID 
Ist-D    (program    ID   for    group   i) 

QO.DISTS     (250)    — >    sample   count 
Ist-D    (queue   size) 

2-D 

LINK. ABLE    (no.    of   links   in   network,    2)    -->  node    ID 
Ist-D    (link   number) 
2nd-D    (    1=    1st   node    j    2=   2nd   node) 


TRACER    (2   X  test   duration/ave.    session  interval,    2) 
— >  no.    of    pkts 
Ist-D    (session   number) 

2nd-D    (    1=   original  pkt   count    for   this    session 
I    2=   pkts    which   reached    destination) 

CLOCK. DATA    (4    x   no.    of   nodes,    2)    — >    time 
Ist-D    (no.    of   hops  =   N) 

2nd-D    (    1=    net   tiae   for   all   pkts   hopping   N   nodes 
I    2=   highest   individual    r,rip   time    for 
a   S-hop   pkt) 

HOP. COUNT    (Ux    no.    of  nodes,    2)    -->  no.    of    pkts 
Ist-D    (number   of    hops   =   N) 
2nd-D    (    1   _   Not   Used 

I    2=   no.    of   pkts  hopping   N   hops) 

saP.SET    (a  selected   no   of   links,    2)    — >   node  ID 
Ist-D    (samole    link  ID    number). 
2nd-D    (    1=    "from"   node   ID    |    2=    "to"    node  ID) 


Fig.    5.4.      SIMSCBIPT    Arrays    (1    and    2  Diaensional) 

"from"   node    for    that   link.        The   subscripted   variable   is   the 
actual    identity   of   rhe   node. 

Finally  for  the  NEIGHBOR. LIST  array,  the  first  argument 
is  a  simple  counting  integer  corresponding  to  one  of  rhe 
above  node's  neighbors  (a  node  may  have  up  to  6  neighbors) . 
The  third  argument  describes  whether  the  subscripted 
variable  will  contain  the  ID  of  the  neighbor  node  (1)  ,  an 
integer  (1  or  0)  indicating  whether  or  not  the  neighbor  is 
active    (2) ,    or  the   channel   value   to   this   neighbor    (3) . 
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3-D 

NEIGHBOR. LIST     (CO. of   nodes,     6,    3) 

— >   node   ID   or    UP/DCWN    or   CY 
Ist-D    (node   n' s    ID) 
2nd-D    (a   number   listing   from    1    to   6   of 

cf   node   n's  neighbors^ 
3rd-D    (    1=   neighbor   ID    I    2=   link  status 

I    3=   CV  from   node   n    to   neighbor) 

BEST. PATH    (no.    of   nodes,    no.    of    nodes*  groups 
families,    2)    — >    node    ID   or  CV 
Ist-D    ("from"   node  ID) 

2nd-D    ("to"    ID   of   either   node,    group  or    family) 
3rd-D    (    1=   best   path   neighbor 

I    2=   CV  thru   best   path   neighbor) 

LINK.MONITOH     (no.    of   nodes,    no.    of   nodes,    3) 
-->    busy  signal    (1)     or   Q   size 
Ist-D    ("from"    node  ID) 
2nd-D    ("to"    node    ID) 
3rd-D    (    1=    idle/busy   status 

I    2=   current   queue    size 

I    3-   max    queue   size  thus   far) 

Fig.    5.5.      SIMSCaiPT  Arrays    (3    Dimensional) 

Another  advantage  of  SIMSCRIPT  is  the  ability  to  create 
and  destroy  multivalued  variables  called  temporary  entities. 
By  using  these  entities,  groups  of  data  can  be  shuffled  and 
processed  thru  queues  relatively  easily.  Another  advantage 
is  an  efficient  utilization  of  memory  space  because  entities 
which  are  no  longer  needed  can  be  destroyed  and  the  memory 
freed   for   reuse. 

The  algorithm  in  Appendix  3  used  two  temporary  entities 
extensively.  The  first  is  the  MESSAGE  entity.  As  snown  in 
Fig.  5.5  the  MESSAGE  entity  is  used  for  both  U-msgs  and 
packets.         There   is    more   information     in   the   SiasCRIPT    a-msg 
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Pig.    5.6.      SIMSCHIPT   Temporary   Entities 

than      in   the     theoretical      a-msg   of      Chapter      IV    simply      for 
efficiency   of      programming    and   data   collection.  Note   that 

several   attributes   of    the    Update      .MESSAGE  and   Packet    MESSAGE 
have   the    same   meaning  and    others   do   not. 

The    PACK     entity    (Fig.         5.6)       is      used    in      the  CV. LATCH 
routine  to      calculate   all   link      channel    values.         A      pack   is 
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created  every  time  a  queue  size  increases  or  decreases. 
PACKS  are  kept  in  a  queue  (called  TIME. QUEUE)  assigned  to 
each  nods*.  They  are  kept  until  the  PACK'S  ENTHY.TiaS  (the 
time  it  entered  the  queue)  is  older  than  the  window.  Each 
PACK  has  a  NUMBER  which  is  the  new  queue  size  which  caused 
the  PACK  to  be  created.  Each  node  may  have  several  links, 
but  all  PACK  are  kept  in  the  same  queue.  Therefore 
PAC, NEIGHBOR  identifies  whicn  PACKs  belong  to  each  link  for 
a  given  node. 

D.   SELECTION  OF  TEST  PARAMETERS 

For  the  purpose  of  the  simulation,  certain  test 
parameters  were  selected  to  be  fixed  and  others  varied.  For 
the  fixed  paramerers,  approximations  were  made  based  on  the 
estimated  performance  char act erisrics  of  a  typical  system  as 
described  in  Chapter  III.  Fig,  5.7  lists  the  major  system 
and  simulation  parameters.  There  is  no  explicit  distinction 
between  fixed  and  varying  parameters.  However  the  estimate 
of  16,000  bps  biu  rate  in  Chapter  III  helped  settle  on  a  set 
of  processing  and  transmission  times  for  messages  estimated 
to  range  from  less  than  100  bits  (U-msg)  to  approximately 
1000  bits  for  packets.  The  ranges  of  the  varying  parameter 
were  also  affected   by  the  .16  Kbps  bit  rate   estimate  on  one 
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end,      and    by      a   performance  threshold  on     the  other.         These 
results   are   discussed   in    greater   detail   in   Chapter    VI. 

FIX2D    PARAMETERS 

Pkt    Processing   Time    in  a    Node  .000  1   sec 

n-msg   Processing   Time  in   a   Node  .00001    sec 

Plct    Transmission   Time   per   Link  .05    sec 

U-msg   Transmission   Time   per   Link  .002    sec 
Number   of    pkts    per   session  1-20 

{uniformly   distributed) 
Links   to   be   sampled  10 

No.    of   Samples    per   Link  1000 

Receiving/Transmitting   factors  1 

(for  eacn  node) 

VARYING  PARAMETERS 

Period  Between  Updates 

Simulation  Time  Limit 

Period  Between  New  Traffic  Sessions 

vJindow  Size 

%   Innsr-Grcup/Family 

Pig,  5.7.   System  Parameters 

Other  input  data  consisted  of  a  description  of  the  test 
network  (Fig.  5.1)  including  the  identification  of  nodes, 
groups,  families  and  links.  The  network  rOpology  was  fixed 
for  all  simulation  runs. 
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VI.   RSSULTS,  CONCmSIOMS  AND  RECOMMENDATIONS 

The  resulus  and  conclasions  discussed  in  this  chapter 
primarily  involve  the  simulation  of  the  update  portion  of 
the  protocol  in  Chapter  IV.  Furthermore,  in  view  of  the 
wide  variety  of  parameters  thar  could  have  been  varied  in 
these  simulations,  many  were  fixed  at  what  was  considered  to 
be  reasonable  approximations  based  on  performance  figures 
used  to  describe  the  theoretical  system  in  Chapter  III.  The 
analysis  cenxered  around  several  parameters  which  were 
considered  potentially  to  have  the  broadest  affect  on  the 
system  response,  including  rhe  interval  between  update 
messages  (or  the  rate  at  which  updates  were  originated)  ,  the 
average  arrival  rate  of  new  traffic  sessions  (or  at  the  rate 
at  which  packets  were  created),  and  window  size. 

\.       RESULTS  AND  OESEHVATIONS 

One  of  the  first  simulations  involved  assigning  a  fixed 
channel  value  of  1  to  all  links  in  the  test  network  (Fig. 
5.1),  defining  the  besr  path  between  any  two  nodes  as  the 
first  path  found  with  the  lowest  net  channel  value  (also 
called  the  shortest  path),  and  then  fixing  all  best  paths 
for  the  entire  simulation.   This  is  a  static  routing  scheme. 
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using  shortest  direct  paths  in  the  sense  of  mininium  number 
of  hops.  This  fundamental  network  scheme  was  used  to 
establish  a  minimum  performance  level  and  was  used  to 
measure  the  effectiveness  of  the  update  program  in  Appendix 
E.  For  the  network  in  Fig.  5.1,  all  best  paths  were 
calculated  and  frozen  at  the  beginning  of  the  simulation. 
Then  traffic  sessions  were  originated  at  intervals  of  .05 
sec  and  .08  sec.  The  network  quickly  congested.  At  an 
interval  of  0.1  sec  the  network  settled  down  with  average 
sampled  queue  lengths  from  2.2  to  3.1  for  a  2000  sec 
simulation. 

The  remainder  of  the  simulations  involved  the  update 
algorithm  applied  to  the  same  network  (Fig.  5.1).  The  tests 
were  divided  into  rwc  groups.  The  first  and  largest  group 
of  simulations  considered  tjie  whole  network  to  be  one  basic 
group  (all  groups  and  family  ID's  were  zhe  same).  This  is 
essentially  unfreezing  the  static  network  by  applying  the 
update  algorithm.  The  second  group  of  simulations  involved 
the  partitioning  of  nodes  into  groups  and  families  which 
could  then  be  compared  to  the  basic  group  simulations. 
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1 .   Basic  Group  Tests 

For  the  test  network  (Fig.  5.1),  the  frozen  path 
baseline  scheme  could  not  function  at  a  new  traffic  session 
period  of  less  than  0.1  sec.  The  basic  group  tests  results 
(Appendix  D)  suggested  that  0.1  sec  was  also  a  good  limit 
for  the  Update  algorithm.  However  runs  at  new  rraffic 
session  periods  of  .08  sec  and  .05  sac  indicated  a  gradual 
loss  of  efficiency  indicated  by  excessive  queue  lengths. 
The  static  network,  on  the  other  hand,  had  demonstrated 
catastrophic  failure  at  these  intervals.  Huns  at  intervals 
averaging  greater  than  0.1  sec  caused  very  little  strain  on 
the  update  algorithm,  therefore  the  traffic  inter-arrival 
interval  of  0.1  sec  average  was  3e_lected  for  the  large 
majority  of  the  basic  group  (and  group/family)  tests. 

At  an  average  traffic  inter-arrival  interval  of  0.1 
sec,  a  message  (session)  averaging  10  packets  was  added 
randomly  to  the  network  at  a  rate  of  10  messages  (sessions) 
per  second.  Simulation  results  indicated  that  after  100 
seconds  of  simulaxion  clock  time,  any  residual  effects  of 
starting  the  simulation  were  undetectable.  Therefore  zest 
results  were  taken  for  simulation  runs  varying  from  100  to 
1000  sec.    Runs  greater  than  1000  sec    gave  no  indication  of 
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new  information  about  the  length  of  queues  or  the  rate  at 
which  packens  could  be  processed.  Therefore  using  an 
average  message  (session)  arrival  time  of  0 .  1  sec  and  a  test. 
duration  from  100  to  1000  sec,  the  primary  focus  of 
simulations  were  on  the  update  period  (or  rate  at  which  new 
update  cycles  were  started)  and  window  size. 

The  update  period  directly  reflects  the  amount  of 
overhead  required  by  the  networic.  In  the  static  networic, 
the  overhead  requirements  are  minimal,  amounxing  to  that 
required  to  initially  establish  the  best  path  network. 
Therefore  it  is  reasonable  to  expect  better  performance  for 
an  increase  in  overhead  traffic.  The  basic  group  test 
indicated  this  improvement. 

The  average  queue  size  was  the  primary  measure  of 
performance.  The  figures  derived  are  conservative 
calculations  since  the  sampling  in  the  second  half  of  the 
test  was  made  of  the  busiest  links  found  in  the  first  half 
of  the  test.  The  static  network's  average  queue  length  for 
a  traffic  inter-arrival  interval  of  0.1  sec  was  2*  packers. 
The  basic  group  algorithm  approaches  xhe  static  network  as 
the  apdate  period  approached  infinity.  Fig.  6.1  shows  the 
decrease   in   average  queue  size   as   the   traffic   session 
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The  curve  labelled  "MAX"  is  the  plot  oJ:  the  largesr 
average  queue  sizes  over  rhe  set  of  experimenrs. 

The  curve  labelled  "MIN"  is  rhe  plot  of  the  smallest 
average  gueue  sizes  over  the  set  of  experiiaents. 


Fig.  6.1.   Queue  Size  vs  Session  Interval  (Basic  Group) 

interval  size  decreases.  As  expecxed,  for  relatively  long 
update  intervals  (> 1  sec),  average  queue  sizes  ranged 
between  1  and  3  packets.  From  there,  as  the  updare  interval 
decreased,  average  queue  sizes  dropped  quickly.  Around  0.1 
sec,  the  average  queue  size  settled  into  a  range  of  values 
between  approximately  .25  and  .75  packets.  Many  runs  were 
made  in  this  range  and  there   was  no  tendancy  for  results  to 
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prefer  any  particular  part  of  this  range  as  the  tesr 
duration  was  varied.  Results  were  very  stable  (see  Appendix 
D)  . 


AVE 
QUEUE 
SIZE 
OVER 
WINDOW 


J. 


time 


WIT^IIXW 


NO  LONGER 
USED 


Fig.  6.2.   Window  Calculations 


window  size  was  also  varied  to  determine  its  impact 
on  average  queue  size.  At  first  the  channel  values  were 
calculated  over  various  window  sizes  based  on  a  linear 
weighted  time  average.  The  weighting  scheme  gave  the 
highest  weights  to  the  aiost  recenx.  queue  sizes.  However 
simulation  results  showed  thar  this  scheme  resulted  in 
larger  average  queue  sizes  than  a  straight  unweighzed  time 
average  as   shown  in   Fig,    6.2   The   height  of   the  blocks 
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represent  the  size  of  the  queue.   Their  width  represents  the 
length  of  time  that  the  queue   did  not  change  in  size.    The 
window  indicated  how  far  back  on  the  rime  line  (in  Fig.  6.2) 
the  program   would  go  -lo     calculate  the  average   queue,   and 
therefore  the  channel  value  for  a  particular  link. 

Window  size  also  proved  to  be  a  very  stable 
parameter.  Window  sizes  between  1  and  10  times  the  update 
period  gav«  no  indication  of  influencing  the  curves  shown  in 
Fig.  6.1  As  the  window  size  increased  to  over  20  times  the 
update  period,  there  were  slight  increases  in  average  queue 
size. 

The  standard  deviation  of  the  average  queue  size  for 
basic  group  tests  varied  slightly  from  1.2  to  2.3  packets, 
with  the  smallest  standard  deviation  for  update  periods  of 
0.1  sec. 

2 .   Family/Group  Tests 

The  basic  group  test  results  were  compared  to  a 
fundamental  static  network  routing  scheme.  The  family/group 
tests  results  (Appendix  D)  were  primarily  compared  to  the 
basic  group  results.  Although  tne  proposed  advantages  of 
the  family/group  aspect  of  the  update  algorithm  presented  m 
this  paper  are  based  on  the  assumption  that  the  majority  of 
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the  traffic  is  confined  to  inner  group  or  inner  family 
transactions,  most  of  -he  family/group  tests  placed  no 
restrictions  on  which  node  sent  or  received  traffic.  Under 
these  conditions,  the  same  set  of  messages  with  the  same 
sources  and  destinations  used  in  the  basic  group  tests  were 
used  in  the  family/group  tests.  Runs  involving  restricted 
traffic  is  briefly  mentioned  at  the  end  of  this  section. 

As  expected,  the  average  queue  size  increased  in  the 
family/group  tests.  For  update  periods  ranging  from  .05  to 
0.5  sec,  average  queue  sizes  varied  from  0.5  to  1.5  packets. 
Additionally,  the  standard  deviation  increased  to 
approximately  3.7  to  4.2  packets.  The  benefits  due  to  this 
drop  in  performance  was  the  decrease  in  overhead  traffic. 
Typically,  the  average  number  of  links  used  by  U-msgs  as  the 
result  of  a  single  node  originating  one  update  cycle  during 
the  basic  group  test  ranged  from  75  to  90  links.  This  is 
because  every  node  had  to  have  a  best  path  for  every  other 
node.  For  a  typical  family/group  test,  the  average  number 
of  links  used  dropped  to  around  23  to  27  links.  Therefore 
for  a  (roughly)  50  percent  improvement  (decrease)  in  maximum 
average  queue  size,  a  200  percent  increase  in  overhead 
traffic  was  required. 
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Another  effect  of  the  family/group  algorithm  is  an 
increase  in  the  average  number  of  nodes  hopped  by  all 
paclcets.  Because  of  the  addressing  given  to  a  packet 
starting  out  for  a  node  in  a  different  family  (it  starts  out 
with  a  family  best  path  neighbor)  ,  more  average  links  are 
normally  required  in  family/group  tests.  An  interesting 
observation  is  that  occasionally  a  few  (most  of-cen  1  or  2  in 
more  than  20,000)  packets  in  a  family/group  test  would  make 
an  unusual  number  of  hops,  clearly  indicating  that  it  is 
looping  due  to  changes  in  its  best  paths.  However, 
invariably  the  total  time  required  for  this  packet  to 
finally  reach  its  destination  was  well  within  the  average 
uimes  required  by  other  packets  which  used  far  fewer  hops. 
The  cause  of  these  (relatively  rare)  oscillations  is  not 
obvious.  It  is  probably  due  to  the  large  number  of  links 
which  cross  a  group  or  family  boundary.  During  an  update 
each  link  represents  an  entry  port  to  that  particular 
related  group  or  family  and  each  acts  as  an  originator  of  a 
a-msg  for  that  larger  entity  (or  super-node) .  Therefore 
from  update  to  update,  the  best  path  port  to  that  super-node 
could  change  by  a  large  physical  distance.  However  it  is 
not  clear  if  this  observation  indicates  a   serious  problem. 
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since  the  packets  still  invariably  arrive  in  a  timely 
fashion.  As  a  safeguard,  an  additional  routine  was  added  to 
the  simulation  program  to  check  the  hop  count  on  all 
outstanding  packets  when  the  test  ended.  At  no  time  was 
there  an  indication  that  an  undelivered  packet  was  looping 
or  making  excessive  hops. 

Compared  to  the  basic  group  simulations,  relatively 
fewer  runs  were  made  for  the  family/group  tests.  However 
these  results  suggested  that  as  the  ratio  of  window  size  to 
session  interval  increased  over  the  range  from  1  to  10, 
average  gueue  size  also  increased  slightly.  Additional 
testing  may  indicate  that  a  relatively  flat  performance  band 
similar  to  Fig.  6.1  also  exists  in  this  case. 

Finally  several  runs  were  made  with  the  same  test 
network  with  the  additional  restriction  that  50  percent  of 
all  traffic  is  inner  group  and  50  percent  of  the  remaining 
traffic  is  inner  family.  There  were  too  few  runs  to 
establish  a  trend.  However  the  results  suggested  a  decrease 
in  average  gueue  size  and  standard  deviation. 

3.   CONCLOSIONS 

This    was   very      much   a    preliminary    investigation      of   this 
network      management      protocol.  It   would      be      improper      to 
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identify  much  more  than  broad  performance  characteristics  or 
trends. 

The  update  algorithm  clearly  functions  properly.  Both 
the  basic  group  concept  and  the  family/group  concept 
responds  to  changing  channel  values  and  provides  routes  that 
can  be  used  under  a  reasonable  traffic  load.  The  algorithm 
is  also  very  stable  and  robust.  Fig.  6.1  indicates  that  for 
a  traffic  session  interval  of  0.1  sec  and  longer,  the 
algorithm  has  a  good  and  very  flat  performance  curve  for  an 
update  period  of  approximately  0.1  sec  and  less. 

Investigating  the  update  interval  should  continue  to  be 
a  focal  point  in  future  analysis.  For  a  given  network 
performance  level  it  will  always  b-a  important  to  minimize 
the  update  interval,  since  it  reflects  the  overhead  traffic 
that  the  network  must  process. 

On  the  other  hand,  as  new  and  broken  links  are 
integrated  into  the  simulation,  they  will  add 
counter-arguments  to  the  continued  increase  in  the  update 
periods.  As  links  are  broken,  ii  alternate  links  are  not 
available,  nodes  rely  on  U-msgs  to  unfreeze  traffic  and 
provide  new  best  paths.  Therefore  future  analysis  must  find 
a  balance  that  will  optimize  this  situation. 


122 


The  family/group  concept  provides  very  good  economy  (and 
robustness,  as  compared  to  gateway  nodes)  with  a  modest 
decrease  in  performance.  For  networks  which  operate 
extensively  within  smaller  sub-network  boundaries  (such  as  a 
typical  military  network) ,  the  family/group  concept  appears 
to  offer  a  significant  savings  in  overhead  traffic  compared 
to  the  same  network  operating  as  one  basic  group. 

C,   RECOMMENDATIONS  FOR  FURTHER  STUDY 

This  preliminary  study  indicates  rhat  the  update  portion 
of  the  decentralized  routing  protocol  described  in  Chapter 
17  accomplishes  the  fundamental  requirement  of  routing  user 
traffic.  Follow-on  investigations  are  needed  to  integrate 
the  new  and  broken  link  concepts  described  in  Chapter  IV. 
Wherever  possible,  the  program  in  Appendix  E  was  written  to 
facilirate  this  next  srep  in  the  investigation.  Ir  can 
similate  the  loss,  gain,  and  the  planned  movement  of  nodes 
by  scheduling  the  failure  and  awakening  of  links  on  the 
simulation  clock.  Eorh  single  node  and  group  movements 
could  be  simulated. 

This  protocol  was  conceived  to  be  simple  and  practical. 
A  degree  of  simplicity  has  been  retained.  However  to  become 
a  practical  protocol,  there  are  several  topics  which  need  to 
be  considered,  that  are  not  addressed  in  this  study. 
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The  primary  problam  is  how  to  cope  with  splintering. 
Splintering  may  be  a  single  node  which  crosses  a  group  or 
family  boundary.  If  this  problem  is  applied  zo  a  single 
basic  group  network,  it  then  reduces  to  the  problem  of  a 
node  leaving  the  network  or  a  new  node  entering  the  network. 

Splintering  may  also  be  defined  as  groups  of  nodes  being 
completely  cut  off  from  the  other  nodes  in  its  basic  group. 
This  sub-group  may  be  left  to  operate  autonomously  or  find 
itself  in  the  middle  of  another  basic  group.  A  practical 
example  based  on  the  military  organizations  mentioned 
earlier  would  be  the  movement  of  a  company,  which  is  part  of 
a  battalion's  basic  group  net,  thru  another  battalion's 
sector.  It  is  conceivable  that  the  company  may  lose  ail 
direct  links  with  its  basic  group  during  the  movement.  A 
practical  protocol  must  also  accommodate  this  splintering  to 
the  point  where  a  basic  group  is  divided  into  two  or  more 
equal  parts,  leading  to  the  question  of  determining  which 
group  is  the  splinter  and  which  is  the  remainder  of  the 
original  basic  group. 

Finally,  assuming  a  practical  protocol  can  be  fully 
developed,  there  is  the  much  more  difficult  problem  of 
xeasuring  its  efficiency  both  in  an  absolute  sense,  and  in 
relation  to  other  existing  decentralized  algorithms. 
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APPENDIX    A 
ALTERNATE   LINK    THEORY 

CLAIM:  During  a  shortest  path  update  process,  it  may  be 
possible  to  identify  an  alternate  link  which  may  be  used  to 
maintain  traffic  flow  (although  at  some  degraded  level)  in 
the  event  that  a  node's  IMMEDIATE  DOWNSTREAM  linJc  in  a 
particular  shortest  path  is  broken.  The  switch  will  result 
in  a  non-optimum  but  LOOPFREE  network.  LOOPFREE  in  this 
discussion  implies  loopfree  in  the  narrow  sense.  That  is, 
traffic  leaving  a  node  for  a  given  destination  is  assured 
that   it    will   not    loop    back   into   the   sending    node, 

DISCUSSION:  Simply  stated,  the  concept  is  that  some 
optimum  path  routing  algorithms  may  acquire  information  that 
is  normally  discarded,  but  may  be  used  at  individual  node 
level  to  switch  traffic  to  an  alternate  link  if  a  break  is 
found  in  that  node's  immediate  downstream  link  along  the 
optimum  path.  This  switch  does  not  necessarily  leave  the 
rest  of  the  network  optimally  routed,  but  it  is  LOOPFREE. 
It  may  be  useful  as  a  temporary  fix  until  the  next  update 
process   is   received. 

PROOF:  Any  set  of  shortest  path  routes  in  a  network  can 
be    expressed   as    a  spanning      tree,       which   is    always  loopfree. 
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In  the  following  examples,  the  spanning  tree  is  vertically 
scaled  to  represent  the  channel  value/distance  to  the  tree 
root.  Bvery  link  is  assumed  to  have  a  minimum  value  of  1, 
however  this  is  not  critical  in  the  proof. 

A  loop  implies  that  a  route  passes  through  the  same  node 
more  than  once. 

If  every  link  has  a  miaia-um  value  of  1,  then  the  total 
distance  for  each  node  in  an  optimum  spanning  tree  to  the 
root  must  be  at  least  one  larger  than  rhe  next  node 
downstream. 

Therefore  a  loop  cannot  exist  in  a  spanning  tree  because 
once  traffic  leaves  a  node  in  a  spanning  tree,  it  will  never 
arrive  at  a  node  of  equal  distance  to  the  root.  Under 
normal  operations,  if  more  than  one  node  has  the  distance  to 
the  root  of  d,  then  a  particular  message  for  that  root  will 
only  pass  through  (at  most)  one  of  these  nodes  of  distance 
d.  Furthermore,  once  traffic  reaches  a  node  of  distance 
less  than  d,  it  will  never  pass  thru  any  node  of  distance  d 
under  normal  traffic  flow  conditions. 

Consider  the  following  network  and  spanning  tree  wita  A 
as  the  root. 


126 


DISTANCE 
TO  NODE  A 


Applying  the  concept  tkat  a  message  will  oniy  pass  thru 
one  node  of  distance  d  to  the  above  spanning  tree,  we  see 
that  if  a  message  is  U  units  away  from  node  A,  it  is  EIIH2S 
at  node  D, S  or  F.  The  message  will  be  at  one  of  these  three 
and  will  never  pass  thru  the  other  two. 

Similarly,  if  a  message  at  node  G  was  transplanted  in 
node  D  or  a  message  in  node  H  was  transpiante'd  in  node  C 
(where  C  and  D  both  have  distances  less  than  a  and  G)  the 
message  could  continue  to  the  roor  withoui:  ever  passing  back 
thru  the  initial  node  (H  or  G)  .  Note  that  this  is  nor  the 
case  if  a  message  in  node  C  was  transplanted  in  node  H. 
Note  also   that  node  H's  distance   is  greater  than  node  C's 
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distance  to  the  root.  This  is  an  indicator  that  a  loop 
condition  is  possible. 

Reviewing  the  above  networic  diagram  we  see  that  there 
are  many  unused  links  if  traffic  to  A  is  restricted  to  the 
Best  Paths  (  »  ) .  However  if  an  established  best  path  is 
broken,  these  links  provide  a  potential  bridge  which  may 
transplant  traffic  from  the  node  which  discovers  a  broken 
link,  to  an  adequate  adjacent  node  which  circumvents  the 
broken  link.  The  necessary  and  sufficient  factor  to 
determine  whether  an  adjacent  node  is  adequate  is  its 
distance  to  the  roox  A.  As  long  as  the  adjacent  node's 
distance  to  A  is  less  than  or  equal  to  the  distance  via  the 
broken  Best  Path  link,  traffic  transferred  to  it  will  never 
loop  back  to  the  transferring  node  (and  presumably  will 
proceed  to  node  A) . 

APPLICATION:  Consider  a  simple  algorithm  where 
cummulative  distance  to  the  root/sink  was  used  to  determine 
the  Best  Path.  At  each  node,  one  best  path  would  ultimately 
be  selected  over  others.  In  making  this  selection  each  node 
learns  the  best  path  distance  to  the  sink  thru  its  adjacent 
neighbors,  adds  its  distance  to  each  adjacent  neighbor  and 
picks  the  Best   Path.    However  the  best  path  distance  from 
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the  non-selected  adjacent  neighbors  may  still  be  asefui.  If 
this  distance  is  <=  the  node's  best  path  distance  to  the 
sink,  and  if  the  node  detects  a  break  in  its  besr  path  link, 
it  may  transfer  traffic  around  the  broken  link  by  using  one 
of  the  adjacent  nodes,  with  the  assurance  that  the  new  path 
is   loop    free.  It    is   perfectly   conceivable     that  more   than 

one  alternate  link  may  be  available  to  a  given  node  ar  one 
time.  Using  the  network  and  the  tree  shown  above  as  an 
example,    we   have: 


NODE/  POSSIBLE    ALTERNATE    LINK(S)/ 

(distance   to    A)  (distances) 

B/(1)  None 

C/(2  None 

D/^i)  E/(a) 

E/(4  3/(1),     D/(4) 
F/(4)  None 

G/(7  Q/i4)  ,     E/iH) 

H/    5  C/(3i  ,     E/M 
1/(6)  None 


Note  that  the  transferring  node  must  still  add  the  link 
distances  from  it  to  the  selected  adjacent  node  oefore 
picking   the   shortest   alternate    path. 
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APPENDIX    B 
DISTRIBUTED    PROTOCOL    ALGORITHM 


SYMBOLS    XHD    DEFINITIONS 


A  (d)    ==>   Set  of   alternate   neighbor   nodes    for   destination  d 
L  (d  I    ==>   Distance   from   3(d)    to   d    (G/d  or    F/d)  ♦   on    best   path 
AL(i,l)    =  =  >   Distance   from   A(d)    =  1    to   d    (G/d   or   c/d)*'  oa    l^s   best    path 


==>    Message    to   neiohbor    indicating   it  has    oeen  selected  B  (d) 


AX(d  ^  ^ 

B  (d)    ==>  Neighooring   node   on   best  path  to  d    (G/d   or  P/d)  • 

*    (3/d  or   F/d)    indicates  that   group  or   faaily  identities   can  be 
use   in   the   aroament   of   these   symbols   in   place  of   d  to   define 
intra-group   and   intra-f amily   operations. 

G/n   ==>   Group  identity  of   node   n 
F/n   ==>   Faaily   identity   of  node  n 
d(i,n|    ==>   Channel    value    (distance)    of   link   froa   node  i   to  node  n 
D  (ni    ==>   Distance    from    node   n   to   node   d  on   its   best   path 
d'    ==>   d,   G/d   or   ?/d    for   inner   group,    intra-group  or 
intra-family  operations   as   required 
T5ANS  ==>   Originate  or   relay   a   message   to    appropriate  neighbor(s) 
3XIT  ==>   Mo  further   action   required 

A.       DPDATE    IHITIATIOH 

I.    Imt    aj(l,d,D(l))    to  all   neighbors   where 

D(l)=    0 

II.    Schedule   next   Update  origination  in   designated   Update   period. 
•3.       H3CEIVE    /    PROCESS    OPDATB 

I.    3cv   a(l,d,D(l))     at  node   i,    5   G/1  =   G/i 

1)  G/i    ne    (not  equal)    G/1 

EXIT  - 

2)  If  3(a)  =  1 

L(dp=  D(l);    D(i»:=   D  (1)  ♦   d(i,l) 

THAHS    0(I,b,D(I)) 

EXIT 


3)    If    B(d)    ne   1   5   D(l)*   d(i,l)    <=  D(i) 
If    L(d)    <   D(l)*   d(i,l) 

A  (d)  :=    A  (d)    0    B  (d) 

AL(d,3(d)  )  ;=   L(d) 
If    any   le  A  fd) 

A  (dj  :=   A(d)-1 
B(d)  :=  1 

L    d    :=   DU);    D(i):=    D  (1)  ■••    d(i,l) 
TRAKS    J(l,a,D{l)) 
EXIT 

a)    If   3fd)    ne  1   5   D(l)    <=   D(i) 
A(d).:=   A(d)     0  1 
AL(d,l)  :=   D(l) 

EXIT 

5)     If    D(l)     >    D(i)     5    1€  i(d) 


If    D(l)     >    D(i)     I 


II.  RC7  0(L,D,D(D)  AT  NODE  I  &  G/I  NE  G/D  S  F/I  =  F/D 
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?ILS:    APB  ?ITIAL  A         NATAL    POSTGBAOOAIS    SCHOOL 


1)    If    ?/i   ne   P/1 
EXIT 


2)  If   G/1  =  G/d  5   1  na  d 

EXIT 

3)  If    B(G 


B  (G/d)    =    1 
L(G/b):=    OIL);    D(G/D)  :=    D(L)*    D(I,L) 


EXIT 


H)    If    D(l)*   d(i,l)    <=   DfG/d)    &    B(G/d)    De  1 
-   ■    *   d(i,l) 

i)    a  r  - 
:=    L 

'  A  ~(G /d )' :  =  ~  A  (G/d)  -  1 


If    L  (G/d)     <    D  (!)♦    d  (i,l) 
"  (G/d)  :=    A  (G/d)     ~    -    - 
_^(G/d,S(G 

If    IC  A  (G/d) 


A(G/d):=    A  (G/d)     0    BrG/d 
4L(G/d,SiG/d)  )  :=    L  (G/d) 
:    ic  A  (G/d) 


B(G/d)  :=    1 

L   G/di:=   1:    D  (G/d)  :=    D(l)*    d(i,l) 

TSANS    U(i,G/d,D  (G/d)  ) 

EXIT 


5)     If    3  (G/d)    ne   1    5   D  (1)     <=   D  (G/d) 
A  (G/d)  :=    A  (G/d)     0    1 
AL(G/d,l)  :=    D(l) 


6)     If    D(l)     >    D(G/d)     5    any    A(G/d)»   1 
Ajd/d):=   A  (G/d)-  1    ' 

EXIT 

III.    RCV    0(L,D,D(L))     AT    HODE    I    5    P/I    HE    P/D 

1)  If    ?/l  =  F/d   &  1  ae  4 

EXIT 

2)  If    B(F/d)    =   1 

L(P/D):=    D  (L)  :     D(F/D)  :=    0(L)*    D(I,L) 
TSA&S   0(i,?/d,D(?/d)) 

EXIT 

3)  If    D(l)*   d(i,l)    <=   DfP/d)    5   B  (F/d)    ne   1 

If    L(F/d)     <    b(l)*    d(l,i) 

A(F/d>:=    A  (F/d)     U    3  (F/d) 
^AL(F/^,3fF/d    ):=    L(?/d) 
If    le  A  (F/d) 

A  (F/d)  :=    X(P/d)-   1 
B (F/d) :=   1 

L(F/df  :  =  .D(1)  :    D(F/d):=   D(l)*   d(i,l) 
TPANS    U(i,F/d,D(P/d) 
EXIT 

4)  If    3  (F/d)     ns    1    &    D(ll     <=    D  (P/d) 

A  (F/d)  :=    A  (F/d)     a    1 
AL(F/d,l)  :=    D(l) 
EXIT 


5)     If    D  (1)    >    D(F/d)     5    any    A(?/d)«   1 
A(F/(f ' 

EXIT 


A  (F/d)  :=    A  (F/d)  -    1 

ixr- 


IV.    Any    traffic  frozen   due   to  X(d*)    is   released   as   soon   as  a    aen 
B(a')     is  selected. 

C.       BROKEN    LINK    PROCESS 

I.    Node   i    discovers    link   vith  node    j   is  broken. 
For  each  d*   s.t.    B  (d)    =   j    : 
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?ILS:  iPB       ?IH1L     k         NA7AL  POSTGRADUATE  SCHOOL 

1)  If  k{i*)    ne  0 

n:=  A(d'l  for  vhich  AL  (A  <d*)  rd')  ♦  d(i,A(d')) 

is  nin  over  A(dM 
s:=  AL(n,d») 
B(d«)  :=  n 
L(d'i:=  s 
TRANS  AI(d«)  to  a 
EXIT 


2)     If    A (d«)    *   0 

TRANS   X(d')     to    all   n»iqhbors 
Freeze  traffic  dastiaed   for  d* 
B(dM    =   0 

EXIT 


II.  Rev  Ifd'l  at  node  i  from  node  1 

1)  If  3(dM  =  1 

PASA.  1.1)  &  2)  AB07B 

2)  If  B(dM  ns  1 

EXIT- 

III.  HcT  AZ(d*)  at  node  i  from  node  1 

If  any  A(d«)  *  I 
A(dM:=  A(d«J-  1 

EXIT 
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APPENDIX  C 
WOaST  CASE  G50WTH  0?  UPDATE  MESSAGES 

It  is  unlikely  thax  any  distributed  routing  algoritha, 
which  atxempts  to  balance  traffic  on  all  links  in  a  busy 
network  and  takes  a  finite  time  to  updare  a  network,  will 
ever  produce  a  network-wide  routing  scheme  which  is  truly 
optimized.  For  example,  delays  due  to  propagation  time  and 
processing  time  in  each  node  will  cause  a  time  difference 
between  the  node  which  originated  the  update  and  the  last 
node  which  was  affected  by  that  origination.  During  this 
period,  particularly  under  heavy  traffic  loads,  conditions 
which  existed  in  and  around  the  originating  node  at  rhe  time 
the  update  was  started  may  be  very  different  from  those 
existing  by  the  time  the  most  distant  node  is  updated. 
Generally,  the  longer  it  takes  for  an  updane  cycle  to 
propagate  throughout  the  network,  and  the  longer  rhe  time 
between  update  cycles,  the  more  conditions  could  change, 
thereby  degrading  an  ideal  routing  scheme.  Therefore  it  is 
germane  zo  consider  how  long  it  would  take  for  an  algorithm 
to  optimize  a  network  if  a  sudden  change  in  link  status 
caused  a  worst  case  sitiuation. 
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It  is  important  to  understand  that  the  following 
analysis  assumes  that  after  the  status  (e.g.  loading)  of  the 
links  have  changed,  they  are  theoretically  frozen  until  tae 
network  achieves  re-optimization.  Without  this  assumption, 
as  stated  above,  it  may  be  impossible  to  arrive  at  a  fully 
optimized  routing  scheme  in  a  changing  network  at  any  point 
in    time. 

For   the   algorithm   presented   in      this  paper,       under    worst 
case     conditions,        it      could      take      up      to       (approximately) 
3x(n**3)       update   messages    to   optimize      a   network    of   n   nodes. 
The   following    figure   shows    a  richly    connected   network. 


#   Indicates   CJ  to  neighbor 

_#_  Indicates   net   CV  to  Node    1 
on  Best  Path. 

(#)  Indicates  new  CV  at  next  update 
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Network  A  shows  the  best  paths  to  Node  1  as  of  the  last 
update.  To  maintain  the  worst  case  conditions,  we  will 
assume  that  the  channel  values  of  the  links  inside  the 
network  (the  star)  are  always  so  large  that  they  will  never 
be  selected  as  a  best  path  link  to  Node  1.  However  each  of 
these  links  will  require  that  another  CJ-msg  be  sent  each 
time  a  node  at  either  end  updates  its  currant  best  path  or 
adopts   a    new   one. 

The  channel  values  in  parenthesis  in  network  B  represent 
changes  in  the  channel  values  since  the  last  update  and  will 
be  used  in  the  next  update  cycle  orJiginated  by  node  1.  As 
the  first  update  cycle  begins,  all  nodes  receive  a  'J-msg 
from  node  1  (for  n=5  nodes,  n-1  U-msgs  are  initially  sent 
out  at  the  beginning  of  a  cycle) .  It  is  assumed  that  (under 
worst  case        conditions)  the  U-msg        is  relayed 

counter-clockwise  (CCW)  thru  node  2  upstream  along  the  best 
path  arriving  at  node  5  sometime  after  nodes  3,4  and  5  have 
rejected  the  direct  U-msg  from  node  1  (because  they  compared 
their  outdated  net  best  path  channel  value  to  the  current 
channel   values   in  the   Q-msgs.). 

As  the  a-msg  thru  node  2  works  itself  upstream  along  the 
best   path,         it    updates      each   node's     net  best      path    channel 
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value      and   causes      each      node    to      relay      the     update   to      all 
neighbors   except    the   sending  node    (n-2    relays   for  n- 1    nodes) 
causing   a    relay   of    (n-1)  (n-2)       U-msgs.         Adding   the  original 
n-1    U-msgs    from    node    1; 

(n-1)  (n-2)    +    (n-1)    =    (n-l)(n-2*l)    =    (n-1)**2. 

In  this  first  update  cycle,  (n-1)«»'*2  U-msgs  have  gone  out 
and  not  a  single  node  has  changed  its  best  parh  neighbor  to 
node  1.  But  this  was  still  a  significant  step  because  each 
node  now  knows  the  true  distance  along  its  best  path  to  node 
1    as    shown    in    Network   C. 


#_  Indicates  net   CV  to  Node    1 
on   Best   Path 


Some    time   later   node    1      originates    its   next    U-msg   cycle. 
This   time       (worst   case)       it   is      assumed    that   the      U-rasg   thru 
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node  2  works  its  way  CCW  to  node  5  before  node  5  receives 
its  U-msg  direct  from  node  1.  This  is  nearly  a  repeat  of 
the  previous  cycle  causing  another  (n-1)=*'^2  U-msg  to  be 
initiated.  However   when     the      U-msg      direcx   from      node      1 

finally  arrives  at  node  5,  node  5  picks  a  new  best  path 
(direct  to  node  1)  and  relays  the  U-msg  to  ail  neighbors 
(except  the  sending  node).  When  node  4  receives  node  5*s 
U-msg,  it  selects  this  new  best  path,  informs  all  neignbors 
and  the  process  continues  until  the  network  has  now  selected 
the   optimum   routing    scheme    as   shown    in    Network   D. 

This      final        series      of      U-msgs        involving      (n-1)  (n-2) 
transmissions   brings    the   total    U-msgs   generated   over   the   two 
update  cycles    (originated    by   node    1)    to 

2  (n-1)**2   +     (n-1)  (n-2) 

which   is   approximately 

3((n-1)=^^2)    — >      3  (n=**2)  . 

Since    there   are   n   nodes  in   the    network,      each  initiating 
its  own      update   during   a      single   network   update      cycle,      the 
total    (worst      case)       number      of   a-msgs      possible   is      3  (n**3) 
(over   two    network-wide    update   cycles  in    this   example) . 
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APPENDIX  D 
SIMULATION  RESULTS 
This  appendix  illustrates  many  of  the  results  of  the 
simulation  runs  for  the  program  in  Appendix  E.  For  all 
results  in  this  annex,  the  only  parameters  varied  were  the 
Update  period,  window  size  and  rime  limit/duration  of  the 
simulation  run.  Data  is  divided  into  two  major  areas;  basic 
group  test  results  (3G)  and  family/group  test  results  (F/G) . 
Each  plot  corresponds  to  the  Update  period  size  indicated  to 
its  left.  The  plotted  data  is  the  average  queue  size  for  a 
run  derived  from  sampling  10  links  (those  having  rhe  highest 
average  queues  over  the  first  half  of  the  simulation  run) 
approximately  1000  times  each  during  the  second  halt  of  the 
simulation  run.  Results  for  a  given  test  duration  are 
represented  by  a  number  corresponding  to  the  size  listed 
adjacent  to  the  plot.  The  vertical  axis  is  average  queue 
size.  The  horizontal  axis  is  the  Window/Update  Period 
ratio. 
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APPENDIX  E 
SIMULATION  PROGRAl-I 

PILS:    DOC  S  i         NAVAL    POSTGBAOOiTE    SCBOOL 

//HOBHAMEX    JOB     (203a, 0058) ,' HERITSCH     1052* , CLASS** 

//♦IAIN    LI!IES=(15) 

//   EXEC    SIM25CLG, REGION. GO=102UK,PAB«.GO=»MAP,SI2E«760K« 

//SYSPrINT    DD    SYSO0T=A 

//^YSPPINT    DD    DISP  =  SHR,0NIT=3  350,7OL=SEH=ttVS00a,DSM=S20  3tt.COHPILB, 

//*DCB= (aECfH=FB,LH2CL=133,BLKSI2E=4l2J) 

//SIB.SYSIH    DD   ♦ 

PEZAMBLE  ^ 

NOHSALLY    aODB    IS    IMTEGZB 
GZNEF.ATE    LIST    ROUTINES 
t  • 

PESaANEST    ENTITIES 

rVERY    MODE    HAS    A    TRANSMIT. PERCENT,     A    RECEI7E. PERCENT,     A    GBOOP, 

A    FA-ILI,    OWNS    A    QOEOE    AND    A    TIME.QOBUE 

DEFINE    TBAMSKIT. PERCENT    AND    RECEIVE . PERCENT   AS    REAL    VARIABLES 
I  t 

TEMPORARY    ENTITIES 

IVERY    MESSAGE    HAS    A    TYPE,     A    RELAYEH,     A    NEXT. STOP,     A    DESTINATIOH, 
AN    INF01,     AN    INF02,     AN    INF03,    AN    INPOU,    AN    INF05    AND    MAY    BELONG   TO 
A    QUSDE 

DEFINE    INPOU    AS    A    REAL    VARIABLE 
EVERY    PACK    HAS    A    :i0a3E3,    AN    ENTRY. 1X32,     A    PAC.8EIGH80H    AMD    Hkl 
3EL0MG    TO    A    TIJ1Z. QOEOE 
DEFIME    TIME. QOEOE     AS    A    LIFO    SET 

DEFINE    ENTRY. TiaS    AS    A    REAL    VARIABLE 
f  • 

EVENT    NOTICES    INCLODS    STOP. SIMULATION .    QO. SAMPLER-    SAMPLE,     C7. LATCH 

IVEHY    SEW. OPDATE. MESSAGE    HAS     A    SENDING.  NODE .     AND    A    TYPE. MESSAGE 

Z7ERY     AF2IVAL. MESSAGE    HAS    AN    ID . MESSAGE . N0MBE3 

EVERY    CONT.OPDATS. MESSAGE    HAS    A    LAST. NODE,     A    NEXT. NODE,    A    NET.CT^ 
A    SCJRCE,     A    FA.aiLY,    A    HOP.CNT    AND    A    GR.OOP 

ZrZRY    ARI7E. PACKET    HAS    AN    ID.NOMBER 

Z'.'ERY    CON.  PACKET.. 1ESSAGE    HAS    AN    IDENT.  MESSAGE. HOHBES 

EVERY    NEW. PACKET. MESSAGE    HAS     A    T. MESSAGE 

EVERY    COMPLETED. TRIP    HAS    A    MES.NDH 
t  I 

DEFINE  OP. DATE. PERIOD,     PROCESSING. TIME,    PKT.XHN.TIHE    AND   TIME. LIBIT 

-\~    'EAL    VAR''"ABLES 

DEFINE  ?3NS.PCNt"aND    RCV.PCNT    AS    REAL    VARIABLES 

DEFINE  Li:iKS    AS    A    VARIABLE 

DZFINE  .".SG.HLT    AS    A    VARIABLE 

DEFINE  I'EIGHEOH.LIST    AS    A    3-OIMENSIOflAL    INTEGER    ARHAr 

DEFINE  BEST.  PATH    AS    A     3-DI?»ENSI0NAL    INTEGER    ARRAI  -^ 

DEFINE  CHANNEL. VALOE    TO    MEAN    INF01 

DEFINE  FAM.LY    TO    MEAN    INF02 

DEFINE  GRP    TO    MEAN    INFOS 

DEFINE  GRPS,     FMLYS    AND    SGFS    AS     VARIABLES 

DEFINE  LINK. ABLE    AS    A    2-DIMENS lONAL    ARRAY 

DEFINE  L:iK.  MONITOR    AS     A    3-DIMEMSIONA  L    ARRAI 

define  tracer  as  a  2- dime  nsion  al  array 

defike  clock. data  as   a  2- dim snsional  real  arrai 

defi?;e  :-:dp.coont  as  a  2-dime;jsional  abbai 

define  5mp.set  as  a  2-dikension al  array 

define  ':o.distr  as  a   1- di memsional  arrai 

define  fam.op.grp  as  a   1- dimensional  arrai 

define  idle  to  mean  0 

define  busy  to  mean   1 

define  packet  to  mean   2 

DZFi:iZ  AVE. :;EM. TRAFFIC. INTERVAL,    PKT.MIN    AND    PKT.MAX    AS    SEAL    VARIABLES 

■DEFINE  EST.  MAX.  OF.  TRAFFIC    AND    TOT.  NEW. TRAFFIC    AS    VARIABLES 

DEFINE  TSAHS.NOMBER    TO    MEAN    INFO! 

DEFI!;E  PACK.N0M3ER    TO    MEAN    INF02 

DEFirS  NODES. HOPPED    TO    MEAN    INF03 

DZFINE  RELEASE. TIME    TO    MEAN    INFOft 

DEFINE  FM.G?    TO    MEAN    INFOS 

DEFINE  YES    TO    MEAN    1 

DEFINE  NO    TO    MEAN    0 

DEFINE  OPDATS    TO    MEAN    1 

DEFINE  TRAF. LIMIT    AS    A    VARIABLE 

DEFINE  WINDOW    AS    A    REAL    VARIABLE 

DEFINE  OP. PAC. RATIO    AS    A    REAL    VARIABLE 
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DEPIMB  PRNT    AS    A    ?AaiABLB 

DEFINE  IN. GROUP,    IN. FAMILY,     SBL2CT0R    AS    RZAL    VARIABLES 

DEFINE  NET. U. LINKS,    UP. STARTS,     MAX. U. HOPS    AS    VARIABLES 

DEFINE  TI.MER    AS    A    REAL    VARIABLE 

DEFINE  SMP. LINKS,     NO. OF. S AMPLES ,    SHP.CNTS    AS    VABIABLBS 

DEFINE  EARLIEST. OPDATE    AND    LATEST. UPDATE    AS    REAL    VARIABLES 

DEFINE  O.XHN.TIHE    AS    A    REAL    VARIABLE 

DEFINE  PEEK    AS    A    VARIABLE 

END    "OP    PREAMBLE 

I  t 

•  I 

B&II 

*tttt  SET    SOME    VARIABLES 


*it    SET    THE    RANGE   OP    PACKETS    PER    SESSION     (PKT.MIH    /    HiX) 

•««    SET    A    LIMIT   ON    THE    NUMBER    OF    SESSIONS     (TRAP. LIMIT) 

•«(«    SET    AN    OPDATE    MSG    TO    PACKET    PROCESSING    RATIO     (U.PAC. RATIO) 


*  tt    SET    AN    UPDATE    MSG    TERMINATION    TIME     (U.XHN.IIflE) 

LET  PKT.MIS    »    \.  - 

LET  PKT.HAX    =21. 

LET  TRAP. LIMIT    =95000 

LET  OP.PAC. RATIO    =    . 1 

LET  U.XMN.TIME  =  0.002 
I  I 

**tttt    READ  AHD  PRINT  INPOT  DlTi 
t  t 

PEAD    N.NODE 

PRINT    2    LINES    AS    FOLLOWS 

NODS  TRANSMIT       RECEIVE         GROUP  PAMILI 

NO.  FACTOR  FACTOR  (PGM    #)  (PGH    ») 

CHEATS    EVERT    NODE 
FOR    EVERY    NODE 

READ      TRANSMIT. PERCENT(NODE)  ,    RECEIVE.  PERCENT  (NODE)  ,    GHOOP(NODE), 
FAMILY  (NODE) 
»  I 

••««:    TRNS.PCNT    AND    RCV.PCNT    ARE    THE    SUM    OF   TRANSMIT    AND    RECEIVE    FACTORS. 
^^ti    INPUT    GROUP    NUKBERS    ARE    ADDED    TO    N. NODE    TO    GET    PROGRAM    GROUP    NUMBERS, 
••(Z«    INPUT    FAMILY    NUMBERS    ARE    ADDED    TO    N .  NODE    ♦    THE    HIGaSST    GROUP    NUMBEB 

••es:       TO    GET    THE    PROGRAM    FAMILY    NUMBER. 
f  t 

FOR    I    =    1    TO    N.NODE,     DO 

LET    TRNS.PCNT    =    TRNS.PCNT    ♦    TRANSMIT. PERCENT (I) 

LET    RCV.PCNT    =    RCV.PCNT    +    RECEIVE.  PEBCENT  (I) 

IF    GRPS    <    GROUP  (I) 
LET    GRPS    =    GROUP (I) 

REGARDLESS 
I  t 

••««    SET    PROGRAM   GRP    HOH 
f  I 

LET   GROUP  (I)     =    GROUP  (I)     ♦    N.  NODE 
LOOP 

RESERVE    FAM.OP.GRP     (*)     AS     (GRPS    ♦•    N.  NODE    ♦    25) 
FOR    I    =     1    TO    N.NODE,     DO 

IF    FMLYS    <    FAMILYil) 
LET    FMLYS    =    FAMILY  (I) 

REGARDLESS  r 

I  I 

••«:<    SET    PROGSAH    PAH    NOH 
t  « 

LET    FAMILY  (I)     =    N.NODE    +    GRPS    +    FAMILY  (I) 
LET    FAM.OF.GHP     (GROUP  (I))     =    FAMILY  (I) 
LOO? 

LET    SGFS    =    N.NODE    ♦    GRPS    ♦    FMLYS 
FOR    I    =    1    TO    N.NODE,     00 

PRINT     1    LINE    5ITH    I.     TRANSMIT. PERCENT (1)  ,    RECEIVE. PERCENT  (I)  , 
(GROUP  (I)     -    N.iNODE),    GROUP  (I),     (FAMILY  (1)     -    N.NODE    -    GRPS),    FAMILY  (I) 
AS    FOLLOWS 

LOOP 

SKI?    1    OUTPUT    LIHB 
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READ  OP. DAT?. PERIOD 

READ  PROCESSING. TIJIB 

READ  PKT.XMN.TISB 

READ  TIME. LIBIT 

READ  AVE.NEH.THAFPIC. INT287AL 

READ  WINDOW 
t 

'te    IN.GROaP    MEANS    THE    PEBCEiJTAGE   OP    GENERATED   TRAFFIC    THAT    aiLL  NOT 
'te       LEAVE    ITS    BASIC    GBOUP.        SIMILABLY    FOB    IN.FAHILY. 

*tt    PRNT    IS    AN    INTEGER    WHICH    CONTROLS    THE    LEVEL   OP    DIAGNOSTIC    PBIHTISG, 

•««  0    ->    INPUT    DATA    ♦    RESULTS 

•««         1    ->    0    ♦    TRACES    ALL    PACKETS    *•    LISTS    INITIAL    NEIGHBOBS    ♦    LIST 

*lt  BEST    PATHS    W/    CV    AT    END    OP    HUH 

*tt         2    ->    1    ♦    ANNOUNCES    CHANGES    IN    BEST    PATHS 

*tt         3    ->    2    ♦    TRACES    ALL    UPDATES    ♦    ANNOUNCES    ALL    NE»    3EST    PATHS 

*tt 

*tt    sap. LINKS    IS    THE    N0S3ER    OF    LINKS    TO    BE    SAMPLED 

•«2    NO. OP. SAMPLES    IS    THE    EXPONENTIAL    MEAN    NUMBEB    OP    SAMPLES    TO    BE    TAKES 

*tt       AT    EACH   OF   SMP. LINKS    LINKS    IN    THE    LAST    HALF    OP    TEST. 

»««:    LINKS    IS    THE    TOTAL    NUMBER    OP    LINKS    IN    THE    NETHOSK. 

READ    IN.GHODP,"lM.F&aiLI 
READ    PRNT 

READ    SHP. LINKS,    NO. OP. SAMPLES 
READ    LINKS 

PRINT    8    LINES    WITH    OP. DATE. PERIOD,    PROCESSING. TIHE,    PKT . XMN. TIHE, 
TI.1E. LIMIT,    TRAP. LIMIT,    AVE.  NEW.  TRAFFIC.  INTERVAL,     WINDOW, 
PKT.MIN,     PKT.MAX,     IN.  GROUP,    IN. FAMILY    AS    FOLLOWS 

0PDAT2    PERIOD    IS    *«.****■«    SEC 

PROCESSING    TIME    IN    EACH    NODE    FOR    ANT    PACKET    IS    .•••♦•*    SEC 

PACKET    TRANSIT    TIME    BETWEEN    AMY    TWO    NODES    IS    .»*•*»•    SEC 

TEST    DURATION    IS    *^«.«-e*-«*a    SEC.     TEST    LIMITED    TO    **•»»    TRAFFIC    SESSIONS. 

NEW    TRAFFIC    SESSIONS    ARE    STARTED    AT    AN    AVERAGE    INTERVAL    Of    **.«!!«»*«t»    SEC 

CHANNEL    VALUE    CALCULATION    WINDOW    IS    »*«,*****•    SEC 

EACH    TRAFFIC    SESSION    VARIES    FROM    *^    TO    *«    PACKETS 

AT   LEAST    •^•.     %    OF    TRAFFIC    IS    INNEB   GEOOP,    ANOTHEB    *• .    S    IS    INNER    FifllLI. 

SKI?    1    OOTPDT    LINE 
•t  I 

'•««    SEE    CHAPTER    6    FOB    DESCBIPTION    OP    ABBAIS 
t  t 

RESERVE    LINK.ABLE(*,*)     AS    LINKS    ST    6 

RESERVE    LNK.MONITORC^,*,-)     AS    N.N0D2    BY    N.NODE    BI    3 

RESERVE    HOP.COONT  {*,"}     AS     (U--^N.NOD£)     BY    2  — . 

RESERVE    CLOCK.  DATA  (*,'^)     AS     (U^N.NODE)     BY    2 

LET    EST. MAX. OP.  TRAFFIC    =    2    *    I :JT.  ?  fTIME.  LIMIT    /    AVE. NEW . TRAFFIC.  INTEBTAL) 

RESERVE    TRACER  (=»,*^)     AS    EST.  MAX  .  OF.  TRAFFIC    BY    2 


^        ')     AS    SMP.  LINKS    BY    2 
Q0.DISTS(*)     as    250 


PRINT    1    LINE    AS    FOLLOWS 
LINK 


I 


FOE  I  =  1  TO  LINKS,  DO 

FOR  J  =  1  TO  2,  HEAD  LINK.  ABLE  (I,  J) 


I  f 

PRINT    1    LISB    WITH    LINK.  ABLE  (I,  1)  ,    LINK.  ABLE  (1,2)     AS    FOLLO«S 

«  • 

LOO? 

•  I 

^'ttet    SCHEDULING  INITIAL  EVENTS 

•  •  et 

''ii    SCHSDOLI  THE  FIRST  UPDATE  FOR  EACH  NODE  (NEW. OPDATE. MESSAGE) 

'  '  ii    FREEZE  ALL  CVS  FOR  THIb  IPDAXE  (CV. LATCH) 

'•«S  SCHEDULE  FIRST  PACKET  SESSION 

''it    SCHEDOLE  TEST  FOR  MAX  QUEUES  HALF  WAY  THBO  TEST 

•  •« 

FOR  EACH  NODE 

SCHEDULE  A  NEW. OPDATE. MESSAGE  GIVEN  NODE,  OPDATE  IN  (ONIFOBH.? 
(0.0, .1,1))  UNITS 
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SCHEDOLE    a    C7. LATCH    AT    0.00 

SCHEDOLE    A    STOP . SlflULATIOH    IM    TIME . LIMIT/U.     OHITS 

SCHEDULE    A     NSW.  PACKET  .?•  ESS  AGE    GIVEN    PACKET    IN     (2    •    .1 
♦■    EXPONENTIAL-?(AVS. SEW, TRAFFIC. INTEHVAL,    Sh     UNITS 

SCHEDOLE    A    00. SAMPLER    IN     (TIM E. LI« 11/2 . )     OMITS 
RESERVE    BEST. PATH  («*,',*)     AS    N.NODE    BY    NGFS    BX    2 
I  I 

'*eett    IDENTIFT    HEIGHBGRS,    SET    INITIAL    CVS    AND  PfilNI 

FOR  I  =  1  TO  N.NODE,  DO 

LET  BEST. PATH  (1,1,1)  '  I 
LOOP 
RESERVE  NEIGHBOR. LIST (*,*,*)  AS  N.NODE  BY  6  BI  3 

FOR  I  =  1  TO  LINKS,  DO 
FOR  J  =  1  TO  6,  DO 


IF  NEIGHBOR. tlST(LIIIK.A3LE(I, 11, J,  1)  »  0 
LET  NEIGHBOR. LIST  (LINK. ABLE  (1,1)  , J,  1)  =L: 
LET  NEIGHBOR. LIST (LINK. ABLE (1,1) , J, 3)  =  1 


LET  M  =  J 
GO  NEXT. STEP 
ELSE 
LOOP 
•NEXT. STEP* 

FOR  J  =  1  TO  6,  DO 
IP  NEIG 


.,^xGHBOR.£lST(LINK.  ABLE(I,2)  ,J-1)  =  0 
LET  NEIGHBOR.  LIST  (LINK. AgLEfl, 2), J,  1)  =  LINK.  ABLE  (I,  1) 
LET  NEIGHBOR. LIST (LINK. ABLE (1,2)  , J, 3)  =  1 


GO  LAST. STEP 
ELSE 
LOOP 

•LAST. STEP* 


LET    NEIGHBOR.LIST(LINK.ABLEfI,  1)  ,H,2)     =    TES 
LET    NEIGHBOR. LIST(LIHK.A5LE(1, 2)  ;J, 2}     =    YES 


LOOP 
II 

IP  ?RMT  >  0 
SKI?  3  OOTPDT  LINES 
PRINT  1  LINE  AS  FOLLOWS 
NEIGHBORS  AND  CHANNEL  VALOES 
FOE  I  =  1  TO  N.NODE,  DO 
'  SKI?    1  OOTPOT  LINE 

PRINT  1  LINE  JilTH  I  AS  FOLLOWS 
KODE  **  NEIGHBORS  AND  CV 
FOR  J  =  1  TO  6,  DO 

PRINT  1  LINE  MITH  NEIGHBOR . LIST (I, J, 1)  AND  NEIGHBOH .LIST  (I, J ,3) 
AS  FOLLOWS  ^ 

LOOP 
LOOP 

REGARDLESS 
I  -' 

'tttt 

START  SiaOLATIOB 
~ ' tttt 
I 

END  ''OP  ailH 

I 

I 

•««    THIS    ROOTINE    HALTS    THE    PROGRAM    AND    GIVES     SEVERAL    STATISTICAL 

'ii       REPORTS    ON    THE    STATOS    0?    THE    SIMOLATION.       AFTER    FODH    REPORTS 

•««       THE    ROOTINE    STOPS    THE    SIMULATION. 
I 

E7ZNT    STOP.SIMOLATION 

DEFINE    TOT. HOPS,    TOT. PACKETS    AND    DELIVERED    AS    VARIABLES 

fEFINE    AVE.TI.'IE    AN"D    A  VE.  MODES .  HOPPilD    AS    SEAL    VARIABLES 

DEFINE    RATIO    AND    IDEAL. TI.1H    .\S    SEAL    VAfilASLZS 

DEFINE    T    AS    A    HEAL    VARIABLE 

DEFINE    SD,XR,Z2,22Saa    AS    REAL    VARIABLES 

••«2    PEEK    COONT    THE    FOOR    REPORTS 

•'C2    TOT. PACKETS    SOaS    THE    TOTAL    PKTS    GENERATED    OP    TO    THIS    POINT 

'*ii    DELIVERED    SUaS    THE   TOTAL    PKTS    REACHING    IREIB    DESTINATION 
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*tt   TOT. HOPS    SUaS    ALL    HOPS    MADE    BY    ALL    PKTS 

•«<    son    SUMS    SAMPLED    Q    SIZES 

*tt    X    IS    THE    TOTAL    DUMBER    OF    SAMPLES 

•««    Z2S0M    IS    THE    SUM    OF    SAHPLE    SIZES    SQOAHED 

LET   ?3:SK=PEEK*1 

LET   TOT. PACKETS   »   0  ■ 

LET    DELIVERED    =0 

LET    TOT. HOPS    »    0  ^  ^ 

LET  saa   =  0 

LET    X    =    0 

LET   Z2SIIH    =    0.0 

I  I 

**tt    93INT    BP    NEIGHBORS    AND    C? 
II 

IF    PENT    >    0  . 

SKIP    3    OOTPaT    LINES 
FOB    I    =     1    TO    N.NODB,    DO 
SKI?    1    OUTPUT    LINE 
PPINT    1    LINE    WITH    I    AS    FOLLOWS 
BEST   PATHS    FROM    NODE    *•*    TO    —    DESTINATIOH   -    BP.  NEIGHBOR    -    CV    FRM    BP . NODB 
FOR    J    =     1     TO    N.NODE,     DO 

IF     (GROUP(I)     =    '5R0UP{J)     AND    I    NB    J> 

P2INT    1.LINE    WITH    J, BEST.  PATH  (I,  J, 1)  ,    BEST.  PATH  (I,  J, 2)     AS    FOLLOBS 

REGARDLESS 
LOO? 
FOR    J    =     (N.NODE-t-1)     TO    NGFS,    DO 

IF    (GROUP  (I)     NE    J    AND    FAMILY  (I)     NE  J    AHD   J    >   H.SODB) 
IF    BEST. PATH     (I,J,1)     NE    0 
IF     (FAM.OF.GR?     (jf    N2    FAMILYfl)     AKD    J    <-     (N.NODE    ♦    GBPS) ) 

GO    OMIT. PRINT 
ELSE 
PRINT    1    LINE    aiTH    J,    BEST. PATH  (I,  J,  t)  ,     BEST. PATH  (I,  J,  2)    AS    POLLOIS 

•OMIT.?RIST« 

REGARDLESS 
REGARDLESS 
LOOP 

Loop 

REGARDLESS  '         '  .  •" 

t  I 

•»««   COUNT    PKTS    CREATED    AND    DELIVERED 
t  t 

FOR    I    =    1    TO    TOT.  NEW.  TRAFFIC,     DO  -^ — 

LET    TOT.  PACKETS    =    TOT. PACKETS    ♦    TRACER     (1,1) 

LET    DELI7EHBD   =    DELIVERED    >    TRACER     (1,2) 
LOOP 
It 

••««    PRINT    SELECTED    INPOT    OATl 
I  I 

3EGIN    REPORT    ON    A    NEW    PAGE 

PRINT    3    LINES    WITH    UP . DATE. PERIOD ,    PROCESSI NG . TIHE ,     PKT . XHN. TIBBr 

TIME. LIMIT,    TRAP. LIMIT,     AVE. NEK . TRAFFIC. INTERVAL,     WINDOW, 

?KT..-*IN,     PKT-MAX,    IN. GROUP,    IN. FAMILY    AS    FOLLOWS 

7PDATE    PERIOD    IS    ^«. ******    SEC 

PHOCZSSING    TIME    IN    EACH    NODE    FOR    ANY    PACKET    IS    .**•*»«    SEC 

PACKET    TRANSIT    TIME    BETWEEN    ANY    T«0    MODES    IS    .*«»••♦    SEC 

TEST    DURATION    IS    «*.» .  ««.r-%**    sj;c.     TEST    LI.-ITED    TO    e*«ft«    TRAFFIC    SESSIONS. 

SEW    r?AFFIC    SESSIONS    ARE    STARTED    AT    AN    AVERAGE    INTERVAL    OF    ««.*«****    SEC 

CKANKHL    VALUE    CALCULATION    WINDOW    IS    i**-*.  ««*«»«    SEC 

EACH    rP.AFFIC    SESSIOW    VARIES    FROM    =-«    TO    "«    PACKETS 

AT    LEAST    **.     1    OF    TRAFFIC    IS    INNER   GROUP,    ANOTHER    *• .     X    IS    INNER    PAMILT. 
I  I 

•'««:    PRINT    PKT    STATISTICS 
I  t 

SKIP    1    OUTPUT    LINE 
PRINT    2    LINES    AS    FOLLOWS 

NODES  NO.  MEAN   TIME  PEAK    TIME  IDEAL 

HOPPED  PKTS  PEE    PKT  TIME  TIHB 

FOR    I    =    1    TO     f2*N.N0DEI,    DO 
IF    HOP. COUNT     (I, PACKET)     NB    0 
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LET  TOT. HOPS  =  TOT. HOPS  ♦  (I  *  HOP. COUNT (I , PACKET) ) 
LET  AVE. TIME  =  CLOCK. DAT  A  (I, 1 )  /  REAL. F iHOP .COUNT (1 .PACKET) } 
LET  IDEAL. TIME  =  I^PKT. XHM . TIME  *     (I- 1) *PHOC£SSING. TIHE 
PPI?JT  1  LINE  WITH  I,  HOP. COUNT(I, PACKET)  ,  AVE.IIME,  CLOCK.  DATA  (I  ,2)  , 
IDEAL. TIME  AS  FOLLOWS 

•«        **m  «.«««*««        «.*«»*•*        *.*««««« 

RSGARDL2SS 
LOOP 
f  t 

'•««  PRINT  ALERT  flSG  IP  A  PKT  HOPPED  MORE  THAN  TOTAL  MOHBEH  CF  NODES 
I  I 

I?    MSG.HLT    MB    0 

SKIP    2    OOTPDT   LINES 

?HINT    1     LINE    AS    FOLLOWS 
=====    NOTE    AT    LEAST    1    PACKET    HOPPED    MORE    THAN    THE    TOTAL    NUHBEH    OF   NODES    « 

SKIP    2    OOTPOT    LINES 
PZGAROLBSS 

LIT   ATE.  NODES. HOPPED    =    REAL.  F  (TOT.  HO  PS)     /   REAL.F{DELI?EBED) 

••<«    PRINT    SELECTED    STATISTICAL    DATl 
•  I 

SKIP    3    OOTPOT    LINES  - 

P?.IHT    1    LINE    WITH    A7E.  NODES.  HOPPED    AS    FOLLOWS 

MIAN    NOMBER    OP    NODES    HOPPED    PER    PACKET    IS       **.* 

SFIP    1    OOTPOT    LINE 

PFINT    1     LINE    WITH    TOT.  NEW.T!? AFFIC    AND   TOT. PACKETS    AS    FOLLOiS 

A    TOTAL    OF         *'*'^    NEW    XMNS    WH32    STARTED     {TOTALING      *••**    PACKETS    ). 

??INT    1     LINE    WITH     (TOT. PACKETS    -    DELIVERED)     AS    FOLLOWS 

OF    THESE,         ^*'*'    PACKETS    WERE    UNDELIVERED    WHEN    THE    TEST    WAS    ENDED. 
SriP    1    OUTPOT    LINE 

LIT    RATIO    =    REAL. F  (NET.  0.  LINKS)/REAL.F(aP. STARTS) 
PrINT     1     LINE    WITH    RATIO    AS    FOLLOWS 

FC?    EACH    NEW    OPDATE,     AN    AVERAGE    OF   ***.*    LINKS    HERE    OSED. 
SriP    1    OUTPUT    LINE 
P?INT    1     LINE    WITH    MAX. 0. HOPS    AS    FOLLOWS 

LCNGEST    BEST    PATH    AT    ANY    TIME    WAS    ^**    LINKS, 
I  < 

''tt    SKI?    TO    END   OF   ROUTINE    IF    STILL    IN    FIRST    HALF    OF    TEST 
r  I 

IF    PEEK    <    3 
GO   CON.TINOB 

ELSE 

I  I 

''ee    PRINT  THE  NOHBEH  OF  LINKS  SAMPLED  AND  TOTAL  SAHPLES  PER  LINK  . 

II  ~— - 

S~I?    1    OOTPOT    LINE 

??INT    3    LINES    WITH    5MP. LINKS,     SHP.CNTE    AS    FOLLOiS 

QCZOE    LENGTH    DISTRIBUTION 

'^'^    LINKS    WERE    SAMPLED 

•**    SAMPLES    /    LINK    WERE    TAKEN 

END    "OP    3ACKRO0ND    DATA 
I  I 

'•«<    PRINT    MAX    Q    LENGTH 
I  I 

I?  PRNT  >=  0 

SKIP  2  OUTPUT  LINES 
PRINT  2  LINES  AS  FOLLOWS 
.riXIMOM  QUEUE  LENGTH: 
FROM   TO   MAI 
FOR  I  =  1  TO  LINKS,  DO 
LET  A  =  LINK. ABLE  (1,1) 
LET  3  =  LINK.  ABLE  (1,2) 
PRINT  1  LINE  WITH  A,3 , LNK. MONITOR  (A, B,3)  AS  FOLLOWS 

PRINT  1  LINE  WITH  3, A , LNK. MONITOR  (B, A, 3)  AS  FOLLOIS 

LOOP 

REGARDLESS 
I  • 

'•«<  PRINT  THE  SAMPLING  COUNT  OF  Q  SIZES  FROM  0  THRO  250,  AND  COHPUTB 
•'««   SUMS  TO  CALCULATE  AVERAGE  ASD  STANDARD  DEVIATION 
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•  f 

BIGIN  REPORT  ON  A  NEW  PAGS 
PrIHT  1  LINE  iS  FOLLOWS 

0-SI2E  -  S&nPLE  DEMSITT 
FC3  I  =  1  TO  250,  DO 

LET    SUM    =     (I-1)*QU.DISTR(I)     ♦    SOH 

LET    X=X*CO.DISTR (I) 

LET    22=    OCr.DISTR  (ij  *(  (I-1)*«2) 

LET  Z2SU:<=  Z2SUM*  22 

IF  gU.DISTRfl)  NB  0 

PRINT  1  LINE  WITH  (1-1)  AND  QO.DISTB(I)  AS  FOLLOiS 

REGARDLESS 
LOOP 

L2T  T  =  SOH/X 

P?INT  1  LINE  WITH  I  AS  FOLLOWS 
AVERAGE  Q    LENGTH  *  ♦«•.«*« 
LIT  XH  =  X 

LIT  SD=  SQRT.F({Z2S0H-  XR* (r««2) ) / (ra-l.)  ) 
Sr.IP  1  OaTPOT  LINE 
PEINT  1  LINE  WITH  SD  AS  FOLLOWS 
STANDARD  DE7IATI0H  =  **.»««• 
I  I 

''it    CHECK  ALL  aNDELITEBED  PKTS.   REPORT  ANT  WITH  A  HOP  COUNT  >  N.H0D8 

??.INT  1  LINE  AS  FOLLOWS 

UVOSUAL  DELAYS  FOR  PACKETS  NOT  DELIVERED  DESCRIBED  BELOW 

?C2    NO.DE    =     1    TO    N.NODB,     DO 

?:3    EACH    MESSAGE    IN    QOEUH  (NO.DE)     «ITH    TYPE  ^lESSAGE)  =    PACKET,    DO 

I?    NODES. HOPPED(MESSAGE)     >=    H.NODE 

PRINT    1     LINE    WITH    RELEASE.  TIME  (MESSAGE)  ,    NODES.  HOPPED  (HESSAGE) 
A3    FOLLOWS 
riCKET    RELEASED    AX   ••*.**•*•*    AND    HAS   ♦♦«    HOPS 

PSGARDLESS 
LOOP 
LOOP 
f  I 

T?   PEEK    NB    * 

.     :;0    CON.TINOB 

?LSS 

STOP 

'CON.TINOB* 
f  I 

"e«    RESCHEDOLE   THE    NEXT    STOP.  SIMDLATIOH 

I  1  - 

SCHSDOLB    A    STOP. SISULATION    IN    TiaE.LIMIT/a.     ONITS 
EVD    "OF    STOP.SiaOLATIOH 
P.  Z  TORN 
ESD 

I  I 

''it    THIS    HOOTINE    IS    CALLED    »HEN    A    NODE    ORIGINATES    AN    OPDATE    3SSSAGE. 

''it      THE    INITIAL    0-HSG    IS    SENT    TO    ALL   OF    THE    INITIATING    NODE'S     NEIGHBORS 
I  t 

?TENT    NEW. OPDATE. aSSSAGE    GIVEN    SENDING. NODE    AND    TYPE.flESSAGB 

LIT    OP. STARTS    =    UP. STARTS    ♦■     1 

70R    I    =     1    TO    LINKS,     DO 
I  • 

''it    CHECK    EACH    LINK    TO    SEE    IP    SENDING. NODE    IS    ON    ONE    END 
t  i 

IF     (LINK.ABLE(I,1)     =    SENDING. NODE    OS    LINK. ABLE     (1,2)     =    SENDING.  NODE) 

CREATE    A    MESSAGE 
LET    TYPE(MESSAGS)     =    OPDATE 
LET    RSLAYSS  (.MESSAGE)     =    SENDING. NODE 
I?    LINK.AflLE(I,  1)     =    SENDING. NODS 

''tt    IF    OPPOSITE    NODE    IS    IN    ANOTHER    FAHILI: 
I  f 

I?    FAHILT    (LINK.  ABLE  (1,2)  )      NE    FAMILY     fS^N  DING. NODE) 
LET    FAM.LY     (MESSAGt)     =    FAHILY     fSENDING.  NODE) 
LET    DESTINATION  (MESSAGE)     =    FAMILY     (SENDINGl.  NODE) 
GO    LIST. NEXT.  STOP 
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ELSE 
I  t 

••««  I?  OPPOSITE  MODE  IS  IN  iSOTHER  GROOP  (SAME  PAflILT)  : 

I?  GROOP  (LINK. ABLZ(I,2n  ME  GROOP  (SENDING. HCDE) 
LET  GRP  (MESSAGE)  =  GROUP  (S  ENDINOr.  NODEi 
LET  DESTINATION  (MESSAGE)  =  GROUP  (SENDING. NODE) 
GO  LIST. NEXT. STOP 

ELSE 
t  f 

'•««    I?   OPPOSITE    NODE    IS    IN    SAME    BASIC   GHOOP 
<  t 

LET    DESTINATION  (MESSAGE)     =    LINK  .  ABLE  (I,  1) 
♦  LIST. SrXT. STOP* 

LET    NEXT. STOP  (MESSAGE)     =    LINK.  ABLE  (1,2) 
ELS" 
IF    FAMILY     (LINK. ABLE  il,  1)  )_    NE    FAMILY     (SENDING.  NODE) 

LET    FAM.LY     (MESSAGE)     =    FAMILY     (SENDxNG.  NODE) 

LET    DESTINATION     (MESSAGE)     =    FAMILY     (SENDING. NODE) 

GO    INCL. NEXT. STOP 
'LSB 
I?    GROOP    (LINK.  ABL2(I,  1)^)     NE    GROOP     (SENDING.  NODE) 

LET    GRP     (MESSAGE)     =    GSOOP     (SEIJDING.  NODE) 

LET    DESTINATION     (MESSAGE)     =    GROUP     (SENDING.  NODE) 

GO    INCL. NEXT. STOP 
ELSE 

LET    DESTINATION  (MESSAGE)     =    LINK. ABLE  (1,2) 
'INCL.SZXT.SIOP* 

LET    NEXT. STOP     (MESSAGE)     =    LINK.  ABLE  (I,  1) 

REGARDLESS 
t  t 

••«<    SCzEDDLE    ARRIVAL    OP    O-MSG    AT    OPPOSITE    HODB 
t  t 

SCBEDOLS    AN    ARRIVAL. MESSAGE   GIVEN    MESSAGE    IH 
O.XMN.TIME    ONUS 
PZGIHDLESS 
LOO? 
t  I 

-••«i    5CZSD0LE    THE    NEXT    05IGINATI0H   OF    A    O-MSG    FOB    THIS    NODE 
I  t 

SCHZ:7LE    A    HEW. OPDATE. MESSAGE    GIVEN    SENDING. NODE    AND    OPDATE   AT 
(:.SI?OEM.F(EARLIEST. UPDATE,     LATES  T.  UPDATE,     3)) 
PETU?5 
END    "0?    NEW. OPDATE 

I 

•ee    THIS    ROOTINE    CREATES    CONTINDED    0-flSGS    HEPEESENTIHG    THE    HELAIIHG 

•2e       :7    A    O-MSG    FROM    A    NODE    AFTER    AN    UPDATE 

I 

EVE??T    C:NT.  OPDATE. MESSAGE    GIVEN    LAST. NODE,    NEXT. NODE,    NET.C7,     ' 
503-31,     FA.aiLY,     HOP.CNT    AND    GH.OOP 
CFIir!    A     MESSAGE 

IZr    TYPE  (MESSAGE)     =    OPDATE 

RELAYER  (MESSAGE)     =    LAST. NODE 
SEXT.STOP(MSSSAGS)     =    NEXT. NODE 
DESTINATION  (MESSAGE)     =    SOURCE 
CHANNEL. VALUE (MESSAGE)      =    NET.C7 
GRP  (MESSAGE)     =    GR.OOP 
FAM.LY  (MESSAGE)     =    FA.MLI 
NODES. HOPPED  (MESSAGE)     =    HOP.  CNT 

•'e«    THIS    RELAYED    O-MSG    IS    SCHEDOLSD    TO    ARRIVE    AT    THE    NEXT    DESTINATIOH 
•'««      iTTEB     a    SELECTED    TRANSMISSION    TIME 
I  I 

SC-r^TLE    AN    ARRIVAL. MESSAGE    GIVEN    MESSAGE    IM 
J.IIH.TIME    ONITS 
RET0E5 

END    ' 'C?    CONT. OPDATE 
f  I 
I  I 

•'««    THIS    ROOTINE    PROCESSES    AN    OPDATE    MESSAGE    AS    IT    ARRIVES    IN    A    N0D2, 
•'^«      22LAYING    IT    TO    NEIGHBORS    IF    APPROPRIATE 
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t  I 

EVZST  ARRIVAL. MESSAGE    GIVEN    ID. MESSAGE. NOHBBB 

LET    -ErSAGE    =    ID.  MESSAGE.  NOMBEH 

LET   THIS. NODE    =    NEXT. STOP  (MESS AGE) 

LET   SZr.a.LINKS    =    SET. U. LINKS    ♦    1 

LET    SODES.  HOPPED  (MESSAGE)     =    NODES. HOPPED  (HESSAGZ)     ♦    1 

**Ct    ID   (:%    OP   LAST    aELAIING    NODE 
I  t 

FOR    I    =    1    TO    6,    DO 

I?   VirGH30R.LIST(THIS.N0DB,    T,     1)     =    RELATER  (HESSAGE) 
LIT    CV. OF. LINK    =    NEIGHBOR.  LIST     (THIS. NODE,    I,    3) 
10   SELECT. BEST.  PATH 
ELSE 
LOOP 

'SE^'"""    BEST    PATH* 
LET'*r5fiL.CVl0F.PATH    =    CV. OF. LINK    ♦    CHANNEL.  VALOE  (HESSAGE) 

**tc   ID   PHEYIOOSLT    SELECTED    BP    NEIGHBOR 
I  I 

LET   HP.SEIGHEOR    =    BEST. PATH (THIS. NODE, DESTINATION (MESSAGE) , 1) 
t  I 

'•««    I?    RELAIEB    =    CURRENT    3P    NEIGHBOR,    OPDAIB    ITS    C7    TO    THE    DESIINATIOB 

•  •«:«      ASD    RELAX    OPDATE 
t  f 

IF    3ILiTER(MESSAGE)     =    BP. NEIGHBOR 

Lrr   22ST.  PATH  (THIS.  NODE, DESTINATION  (HESSAGE)  ,2)     *    CHANNEL. VALOE(BESSASE) 

I?   ?EIT    >=    3 
SKI?    1    OOTPOT    LINE 
PBrST 
Cc 

kz  -:llows 

NODE   ^*    OPDATES    CV    THRO    SAME    BP    TO   •»  (THfiO   ♦*)     AS    ♦«•♦♦*•=    «»*    AT   •*.*••••»    SBC 

s?::?  1  OUTPUT  line 

REGAEDLESS 
f  I 

GO    SELAI. UPDATE. TO. NEIGHBOBS 
ELSE 

4    < 

••<«    I?   THERE    HAS    NO    BP    NEIGHBOR,    ADOPT    RELAIEB    AS    BP    NEIGHBOB    AMD 

•  "ee      ZELA?    UPDATE 
II- 

IF    5?.5rIGHBOR    =    NONE 

LIT    HIST.  PATH  (THIS.  NODE, DESTINATION  (MESSAGE)  ,  1)     =    R  EL  AYER  (MESSAGE) 

LIT    iZ3T.  ?ATH(THIS.  NODE, DESTINATION  (flESSAGE)  ,2)     =    CHAliNEL.  VALUE  CHESSAGB) 

LZr    ;?. NEIGHBOB    =    RELAY ES (MESS AGE) 
ft 

IF    ??5r    >=    3 

SSI?  1  ODTPDT  LINE 

??.:>":  1  LINE  WITH  THIS.  NODE,  DESTINATION  (MESSAGE)  ,  3P. NEIGHBOB,  TIME.?, 

"^■"1'  .CV.OF.-'ATH    AS    FOLLOWS 

sii"5£ST'PATH    FROM    *««    TO    *•    NOB   THBO    *•    AT    **.»♦••**    SEC.    BEST    NET    CV=    •*• 

s?::?  1  OUTPUT  line 

REGARDLESS 
I  I 

GO    EELAT. OPDATE. TO. NEIGHBORS 

ELSE 
I 

*lt    I?   THE    RELAIEB    IS    NOT    THE    3P    NEIGHBOR,     AND    IF    THE    NEW    PATH    IS 

•«c      3Z0RTIH    THAN    THE    OLD    BEST    PATH,    aAKE    RELAYEB    THE     SEW    3P    NEISHBOB 

•«:e      iND    RELAY    THE    UPDATE 

I 

FOP    :=    1    TO    6,    DO 


'BrST    1     LINE    WITh'tHIS.  NODE,    DESTI  NATION  (HESS  AGE)  ,     BP. NEIGHBOR, 
CEiS!TEL.  VALOE(MESSAGE)  ,    CV. OF. LINK,    TOTAL.  CV. Of  .  PATH  ,    TIflE.7 
i----Tnu<; 


I7"jIiaHE0R.LlSTfTHIS.N0DE,I,  1)     =    3P-:?EIGHB0B 
-Z:    CV. T0.3P.NSI5Ha0H    =    NEIGHBOR. LIST  (THIS. i 


NODE, I, 3) 
C-^    COMPARE.  CVS 
ELSE 
LOOP 

•C0S?\?Z.C7S» 

IF    (rIc:.PATH(THIS.NOOE,DESTISATION(aESSAGE)  ,2)     <■    C7.T0.BP.  HEIGHBOB)     > 
TOIiL.CV.OF.PATH 
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L2T  OLD.BP    =    HP.NSIGHBOa 

LET  OLD. Cr    =    3EST.PATH     fTHIS  .  NODE,     DSSTINiTION  (MESSAGE)  ,     2) 

LST  LNK.CV    =    CV.TO. 3P.SEIGHS0R 

LET  3EST.  PATH  (THIS.  MODE,    DESTINATION  (MESSAGE)  ,     1)     =    3  ELAYER  (H  ESSAffE) 

LET  5SST.  ?ATH(rHIS.  :10DE,    DESTINATIOS  (MESSAGE)  ,    2)     =    CHAMNEL.  V  ALUS 


fHESSAGS) 

LET    aP.NEIGHBOS    =   2 ELATSR (aESSlGB) 

PRHT    >=    2 

SKIP    1    OOTPOT    LI?IE 

?3IM7    1    LIME    WITH    T!TIS.  NODS,     DESTINATION  (MESSAGE)  ,     3P. NEIGHBOR-    TIHB.7, 
CHASnEL.  VAL0S{?1ESSAGE)  ,    C7. OP. LINK,    10  T&L.  CV.OF  .  P  ATH    AS    FOLLOWS 
HE»    BEST    =ATH    FBOK    **    TO    **    SOW    THr.O    **    AT    •».»♦•••*    SEC.    CV=    •♦«♦*»•=    »< 


PRINT     1    LIME    SITH    OLD. 3?-    OLD.CV,    LNK.CV,     (OLD.CV    «•    LNK.CV)     AS    FOLLOBS 
OLD    BP    THRO    «*    HAD   CV    OF    ***    ♦    ***    =    *•• 

SKIP    1    OUTPUT    LINE 
P.EGAROLESS 
I  f 

GO    RELAY. OPDATE. TO. NEIGHBORS 
'LSE 
«■'    IP    SEi    PATH    IS    NOT    BETTER    THAN    THE   OLD    BEST    PATH,    DISCONIINOE   3-HSG 

GO    DISC0NTIN02. ORIGINAL. MESSAGE 

*'te   IP    A    NEW    BP    IS    SELECTED    OR    AN    OLD   3P    IS    OPDATED,    PREPARE   INFORHATIOI 
**Ct       FOB    THE    NEXT    O-SSG    TO    ALL    MEIGHfiOHS 

• EILAY.nPDATE. TO. NEIGHBORS' 
?Cl    I    =     1    TC    6-    DO 

I?    NZIGHBCr.LlST     (THIS. NODE,    I    .     1)    =    BP. NEIGHBOR 

LET    CV.T0.BP.NEIGH3OB    =    NEIGHBOR .LIST     (THIS. NODE,    I,    3) 
GO    COHPCTS.NET.CV 
ELSE 
LOO? 

'CCaP0T2.NET.C7* 
LZr    HBT-CV.PFOa. THIS.  NODE    =    BEST- PATH    (THIS.ilODS,    DESTINATION  (MESSAGE)  ,2) 

♦    C7.T0. BP.SEIGHBOB 
FOE    I    =     1    TO    6,    DO 

.       I?    NEIGHBOr.LlST     (THIS. NODE,     I,     2)     =    YES 
IF    }iZIGH50=- T.T_^T    r-r'KT'^  .  »jnn?.    T  .  ^\     >;'    rft 

LET    UPSTI 
t  f 

*'ce    I?    OPSTEEAM    NODE    IS    IN    ANOTHER    FAMILY    AND    THIS    IS    A    INTRA-FAfllLI 
•  'it      0-aSG,    SELAY    IT 


U    0,     uu 

10?. LIST    (THIS. NODE,    I,    2)     =   YES 

;50?.LIST     (THIS. HODS,    I.l}      NE    RELAYEP     (MESSAGE) 

TSEAM.NODE    =    NEIGHBOR. LIST     (THIS. NODE,    I,     1) 


IF     (FAM.LT(MESSAGE)^    NB    0    AND    FAMILY  (OPSTREAil.  NODE)     NE    FAM.LY  (MESSAGE)  ) 

GO    RETEANS.aPSTHEAfl 

ELS  2 
•  » 

••<«:   IF    IPSTPEAH    NODE    IS    IN    ANOTHER    GROOP    AND    THIS    IS    A    INT2A-GR00P     (SAME 
"ce      FS>aiLY)     O-KSG,    RELAY    IT 

IF     (GRP  (5ISSAGE)     VZ    0    AND    GROOP  COPSTREAM.  NODE)     NE    GBP  (MESSAGE)  ) 

GO    RETEANS. UPSTREAM 

SLS2 
t  t 

••««    I?    UPSTEZAM    NODE    IS    IN    THE    SAME    BASIC    GROOP    AND    THIS    IS    A    BASIC     * 
"it      G300P    ORIGINATED    U-MSG,    RELAY    IT 
I  t 

IF     (3RO0F(aPSrREAM.NODE)     =    GROOP  (THIS  .NODE) 

AND     FA!*. LY  (MESSAGE)     =    GHP  (SESS  AGE)  ) 

GO    aETHlNS.OPSISEAM 

ELS2 
I  t 

••ee    IF    NONE   OF   THE    ABOVE,    OPSTHEAM    NODE    DOES    NOT    GET    A    O-MSG 
f  I 

GO    SKI?. PRINT 
•EETRANS.UPSIREAM' 

LET     =OPS    =    NODES.  HOPPED  (MESSAGE) 

SCHEDOLE    i    CO.KT.  UPDATE.  MESSiGS    GIVE'i    THIS.SODE,     UPSTREAM.  NODE, 
NET-CV. FROM. THIS.  NODE,     DESTINATION  (r.ESSAGZ)  ,     FAM  .  L  Y  (MESSAGE)  ,    HOPS, 
AND    GBP  (MESSAGE)     IN     (PROCESSING .  TIME    *    UP.PAC.  RAIIO)     UNITS 
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•SKIP.  PRINT' 

RZGARDLESS 
REGIBOLESS 
LOOP 
I 

*tt  IH    THE    SIHOLATION,    ALL    a-HSGS    ARE   DESTROYED    AFTER    TRAVELLING   3HB 

•««  LINK.        H0WEVE3    THE    UPDATE    CYCLE    PROCEEDS    ACCORDING    TO    THE    BASIC 

•««  CONCEPT    BECAUSE    THE    ARRIVING    U-f.SG    CAUSES    MEW    U-rtSGS    TO    B2 

*tt  INITIATED    IF    A    NEW    BP    MAS    SELECTED    OH    AN    OLD    BP    WAS    UPDATED. 

•««  I?    A    NODE    COULD    NOT    USE    AN    INCOSING    U-flSG,    IT    IS    DESTROYED 

•««  SITHOUT    GENESAIING    ANY    NEW    U-dSGS. 
• 

DISCOSTINOE. ORIGINAL. MESSAGE* 
TF    NODES.  HOPPED  (MESSAGE)     >    MAX.  0. HOPS 

LET    "AX.  U. HOPS    =    NODES.  HOPPED  (HESS  AGE) 
REGARDLESS 

DESTROY    MESSAGE    CALLED    ID  .  MESS  AGE. NOSBEB 
HETUBH 

END    "OP    ABHI7AL.0PDATS 
«  • 
t  t 

••«*    THIS    HOOTINE    CALC0LAT5S    CHANNEL 
••<«      AVERAGE    OF    QUELIE    SIZES    OVER    A 

'•«<      QUEUE    SIZE    INFORHATION    OLDER    T 
t  t 

EVENT    C7. LATCH 

DEFINE    EDGE,     LAST,    SUM,    LAS. 00,    SPAM,    HID,    A2SA,    BEIGBT,    BLOCK 

AND    REMAINDER    AS    REAL    VAEIABLES 
DEFINE    NONE    TO    MEAN    0 
FOE    THIS. NODE    =    1    TO    N.NODB,    DO 
t  I 

•'««    DESTROY    QOEDE   INFORMATION    BEYOND   SINDOi    SIZE.       "PACK"    IS    A    PACKAGE 
••««      0?    INF03MATI0N    DESCRIBED    LATER. 


VALUES    BASED    ON    A    TIME-HEIGHTBD 
SPECIFIED    TIME    CALLED    THE    WINDOB, 
HAN    THE    iilNDOU    TIME    IS    DISCABOED. 


DE)     HITH    ENTBY.  TIME  (PACK)    < 
NODS) 

lOB 
25 


FOR    EACH    PACK    IN    TIME.QOEOB     (THIS. NO 

(TIME.  7    -    WINDOW)  ,    DO 

REMOVE    PACK    FROM    TIME. QUEUE     (THIS. 

DESTHCY    PACK 

.LOOP 
f  t 

•»««  CALCULATE  THE  CV  TO  EACH  NEIGHB 

FOE    J    =    1    TO    6,    DO 

IF    NEIGHBOR. LIST     (THIS. NODE,    J,     2)     =    YBS 

LET    NEIB    =    NEIGHBOR. LIST     (THIS. NODE,    J,     1) 

LET    EDGE   =0.0 

LET    LAST    =    TIHE.7 

LET  sua  =  0.0 
LET   LAS.QU    =    0.0 
1ST    ANY. PACKS    =    HONE 

FOR    EAC3    PACK    IN    TIMS.aOEOE     (THIS.  NODE)     WITH    PACHEIGHBOB     (PACK)     = 
NEIB,    DO 

LET    IKT. PACKS    =    YES 

LET    SPAN    =    LAST    -    ENTRY. TIME     (PACK) 

LET    ;ID    =    SPAN/2.    *     EDGE 

LET    i2EA    =    REAL.  ?(NUMBER(PACK))     *    SPAS- 
LET    BLOCK    =    AREA 

LET    SU2    =    SUM    ♦    BLOCK 

LET    EDaE    =    EDGE    >    SPAN 

LET    LAST    =    ENTRY. TIME (PACK) 

LET    LAS.QO    =    REAL.  F  (  NUMBER  (PACK) 
LOOP 
IF    ANY. PACKS    =    NONE 

LET    LAS.gU    =    LNK. MONITOR     (THIS. NODE,    3EI3,    2) 
rEGARDLISS 

LET    REMAINDER    =    WINDOW    -    EDGE 
LET    MID    =     (REMAINDER/2.)     >    EDGB 
LET    ABEA    =    LAS.QO    *    aSMAINDES' 
LET    BLOCK    =    AREA 
LET    SUM    =    SUM    ■••    BLOCK 
LET  CV.OF.LINK    =    INT. F (SOH/WINDOi    ♦    1.) 


) 
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LET    NEIGHBOR. LIST    (THIS. MODE,    J,    3)     =   C7. OP. LINK 
t  t 

REGARDLESS 
LOOP 
LOOP 

• 

•<:«  3CHSD0L2    THE  NEXT    C7    CALCOLATION    FOR    ALL    NEIGHBORS.       IN    THE 

•<«<  SIMULATION-  THIS     PROCESS    IS    SINCHH0NI2ED    FOH    EVEEI    NODE    III 

'at  THE    NETWORK  (SEE    CHAP    /I). 

t 

SCHEDOLE  A  CV. LATCH  IN  (2*UP.D  ATE.  PERIOD)  ONUS 

'it  EARLIEST. UPDATE  AND  LATEST. UPDATE  SAT  THE  NEXT  INTERVAL  DOHING 

'it  WHICH  ALL  NODES  HILL  PANDOMLY  INITIATE  AN  UPDATE  CYCLE.   THE 

*Zi  S'ZXT  CV. LATCH  FOR  ALL  NODES  IN  THE  NETWORK  OCCURS  AT  THE  VERT 

'te  3ZGINNING  OP  THIS  INTERVAL.   AfTER  THIS  PERIOD,  THERE  IS  ANOTHES 

'et  EQUAL  SIZED  PERIOD  DURING  WHICH  NO  UPDATE  CYCLES  ARE  INITIATED. 

' Zi  5UT  THIS  PERIOD  INSURES  THAT  ALL  CYCLES  STARTED  DURING  THE 

' £i  EARLIEST. UPDATE  TO  LATEST. UPDATE  PERIOD  WILL  BE  COHPLETED. 

'te  DURING  THESE  TWO  PERIODS,  THE  CV  FOR  ALL  LINKS  ARE  FROZEN. 
f 

LET  EARLIEST.  UPDATE  =  TIME.  7  •••  <2*^    UP. DATE.  PERIOD) 
"IT  LATEST. UPDATE  =  TIME. 7  ♦  (3*  UP. DATE. PERIOD) 
.-ETDPN 

END  "OF  C7. LATCH 
I 

t 

*ee    THIS    ROUTINE    GENERATES    A    TRAFFIC   SESSION    MADE    UP    OF   A    RANDOH 

*<t       NUMBER    OP    PKTS     (BETWEEN    PRESCRIBED    LIMITS).       PKTS    ARE    SENT   OOT     ' 

>tt      ON    IDLE    LINKS    IF    AVAILABLE,    OR    STORED    IN    QOEOES    IF    LINKS    ARE    BOSI. 

EVENT    NEW. PACKET. MESSAGE    GI7EM    T. MESSAGE 

DEFINE    CK.XMTR,    CK.ECVR,    X. TOT. PERCENT    AND    H. TOT. PERCENT   AS    HEAL 

VARIABLES 
LIT    X. TOT. PERCENT    =    0 
LET    P. TOT. PERCENT    =    0 
LET   CK.XKTR    =    UNIFORM.  P  (0  .0 ,    THNS.PCNT,    2) 

*-'tt    SELECTOR    IS    USED    IF    A    PERCENTAGE    OP    THE    TRAFFIC    IS    REQOIHED 

•  ' te      TO    BE    INNSR-GRODP/FAttlLr 
t  t 

LET    SELECTOR    =    UNIFORM. F (0. 0,     100.,    9) 

••(2«    SELECT    THE    TllANSMITTING    NODE  -^- 

i  • 

FOR    I    =    1    TO    M.NODE,    DO 

LET    X. TOT. PERCENT    =    X .TOT. PERCENT    *    TRANS  MI T. PEHCSMT (I) 
IF    CK.XKTR    <=    X. TOT. PERCENT 
LET    XHTR    =    1 
GO    FIND.HECEI72H 
ELSE 
LOOP 

•  I 

'•««    SELECT    THE    RECSIVBH 

•  f 

•  FIND. RECEIVES* 

LET   CK.3C7R    =    UNIFORM  .  F  (0  .  0  ,    HC7.PCNT,    3) 
?CR    J    =    1    TO    N.NODS,     DO 

LET    S. TOT. PERCENT    =    R .TOT. PERCENT    ♦    RECEI7E . PERCENT (J) 

IF    CK.3CVH    <=    R. TOT. PERCENT 

GO^'CK. GROUPS.  AND.  FAMILIES 
ELSE 
LOOP 
f  I 

**tt    IP   THE    RECEI7SR    MUST    3B    INNER-GROUP    OH    FAMILY,    KEEP    LOOKING    UNTIL 

•  *  a       AN    ADEQUATE    RECEIVER    IS    FOUND 
t  t 

•CK.GROOPS. AND. FAMILIES' 
IF    SELECTOR    <    IN. GROUP  ^ 

I?    GPOa?(XnTR)     =    GH00P(HC7H) 
GO    SEE.IF.XMTR.EQ.RC7H 
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ELSe 

LET    R. TOT. PERCENT    =   0.0 
GO    ?IND. RECEIVER 
'LSB 

IF    SELECTOR    <     (IN.GPOOP    ♦    IH.FAHILI) 
IF    FA.1ILY  (XHTH)     =    F  ArtlLY  (RC7H) 

GO    SZE. IF.XaTR.EQ.HCVa 
ELSE 

LET    R. TOT. PERCENT    »    0.0 
GO    FIND. RECEIVES 
ELSE 

' SES.IF.XHTR.EQ.HCVB* 
IF    RCVR    =    XMTR 

LET  R. TOT. PERCENT  «  0.0 
GO  FIND. RECEIVER 
'"LSE 

•  DERIVE. N0M3EH. 07. PACKETS' 

LET    PKT. COUNT    =    INT.  F  (UNIFORM.  F  (PKT.  MIN,     PKT.  HAI,     *)  » 
t  • 

••««    COOST    TOTAL   TRAFFIC    SESSIONS.       THE    THACEH    AHflAI    KEEPS    TRACK- 01^ 
••«<       SESSION    INFORMATION 
t  t 

LET   TOT. NSa. TRAFFIC    =    TOT .NEW. TRAFFIC   ♦    1 
LET    TRACER    tTOT. NEH. TRAFFIC,     1)     =    PKT.COOMt 

••««:    CREATE    A    aESSAGB    FOR    EACH    PACKET 
f  • 

FOR    I    =    1    TO    PKT. COUNT,    DO 
CREATE    A    MESSAGE 

LZr    TYPE  (MESSAGE)     =    PACKET 
LET    SELAIEH  (MESSAGE)     =    XMTR 
LET    FG    =    0 

•  • 

*'it    ADDRESS    PKT    TO    NODE,    GROUP    OR    FAMILY    OF    DESTIMATIOH    AS    APPROPSIlISr 
t  • 

IF    FAMILY  (XMTR)     NE    FAMILY  (RCVR) 

LET    BP.NODE    =    BEST.  PATH     fXMTR,     FAMILY  (RCTH)  ,.    1^ 

LET    FM.GP  (MESSAGE)^    =    FAMILY  (RCVR) 

LET    FG    =    FAMILY{RC7R) 

30    ADD. DESTINATION 
ELSE 
IF    GROUP  (XMTR)     NE    GROUP fRCVR) 

LET    3?.N'0DE    =    3EST.PATH     (XMTR,     GeOUP(RCVE),    1) 

LET    FM.G?(MESSAGE)     =    GROUP     (BCVS)  ^ 

LET    FG    =    GROUP     (RCVR) 

GO    ADD. DESTINATION 
ELSE 

LET    BP.NODE    =    BEST.  PATH     (XMTR,     RCVH,    1) 

•  ADD. DESTINATION* 

LET    DESTINATI0N(MESSAGE1     =    RCVR 

LET    TRANS. NUMBER  (MESSAGE)     =    TOT. NEB. TRAFFIC 

LET    PACK.  NUMBER  (MESSAGE)     =    I 

LET    NEXT. STOP (MESSAGE)     =    BP.NODE 

••«<    IF    LINK    TO    BP    NEIGHBOR    IS    IDLE,     SEND    OUT    PACKEt 

IF    LNK. MONITOR     (XMTR.    BP.NODE,     1)     =    IDLE 

SCHEDHLS    AN    ARIVS. PACKET    GIVEN    MESSAGE    IN    PKT.XMN.IIflB    OHITS' 
LET    LSK.MONITORiXMTR.    3P.  NODE,     1 )_    =    BUSY 
LET    RELEASE. TIME     (MESSAGE)     =    TIHE.V 

ELSE 
t  I 

'•«<  IF  LINK  IS  BUSY,  STORE  PKT  AT  END  OF  QUEUE  FOE  THAT  LIIK^ 
t  • 

FILE  2ESSAGE  IN  OOEUE  (XMTR) 

LET  LHK.MONITOR(XMTR,  BP.MODE,  2)=  LNK.  MONITOR  (XMTR  ,  BP.NODE,  2)  ♦-t 

IF  LNK. MONITOR ( XMTR, 3  P. MODE, 2[>LNK. MONITOR  (XMTfi,DP. NODE,  3) 

LET  LNK. MONITOR (XMTR, 3P. NODE, 3)  =  LNK-MONIICfi (XaiR,BP. N0D2r2) 

REGARDLESS 
I  t 

••<<  IF  LINK  QUEUE  CHANGES,  CREATE  A  "PACK"  (A  PACKAGE  OP  INFORMATIOS>^- 
•'e«   SHICH  CONTAINS  THE  NEW  QUEUE  SIZE  AND  THE  TIME  IT  dkS    CHANGED 
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•  •*<      POa    THE   LATEa   CILCOLATIOH  OF.  Cft. 

C32ATB    \    PACK 

LZT    H0n3ER(PlCiC)     =    LHK.flOITITOa     (iaTH,aP.S00B,2j£^ 

LET  EVTaY.rr:;2(PACK)   =  timb.? 

LZT    ?AC.5JEISHaOS  (P.\C5)     =    BP. HODfc 
FILE    PACK    IN   TIHE.Q02a2(iaTB>:- 
BEGARDL2SS 
t  I 

TF    PRVT    >=    1 

PRI^tT    1    LINE   WITH   T0T.ME3.Ta AFFXCr    I,    XHTSr    BP^SODE,FG,    HCVS,    TIHff.Ti 
LN'K..'10NITOB(X2T3,     BP.MODE,    2)     AS    PCLLOaS 
0-**if>i* /ttit    INITIATED    FHOa    »*    Ti£20   *»(««)     TO    ••    AT   •>.*«•••♦    SEC*    20=      • 
SKI?    1    OOTPUT    LIHE 

PEGARDL2SS 
I  i 

LOOP 
f  f 

••(««    RESCaEDOlB  5BXr  THAFFIC  SESSIOIT    OP    TO    SAX   SET   BT    TBAFFICLIfllE^- 
f  t 

I?    TOT.S'SW.THAFFIC  <    TBAF. LIBIT 

SCHEDULE    A    NEtl. PACKET. aZSSAGE    GI7BN   PACKET  IV 
SXPCS'ZlITIAL.PtATE.MEH.TEAFFIC.INTEBVAI.,     1>     OSITS  ..  ' 

REGARDLESS 
RETDRS 
END    "OF    ITEW. PACKET- 

t  t 

•  '  it   THIS    aOOTIHB   PHOCBSSBS    PKTS    AS  THBI    ABBITB  IMA.  SOOE£s 
t  t 

EVEtIT    ARI7B. PACKET  GIVES   ID.TOaBBK 
LET    MESSAGE    =    ID.StiaBEa 
LIT    THIS. NODE    =    .VEIT.  STOP  f3BSS  AGBK 
LET    FAST.SODE   ~   aELAIEH  (SBSSAGE) 

IF    PPNT    >=    1 

??i;iT    1     LINE    WITH    TBAtlS.SaHBSH  (MESSAGE)  ,     PACK.  UOMBEa  (HESSAGZ^^ 

?ELAYE?.  (-ESSAGE)  ,    :i  EXT. STOP  (aoSSAGE)  .    TIME. 7    AS    POLLOHi 
--•MT*i /A-,    ARRIVES    FEOa    **    ISTO    «*    AT    **.•**«*»    SEC 
P.EGAEDLESS 
■  I  t 

•  •«<    IF    THE    PKT   HAS   aBACHED   ITS    DESTIUATIOIT,    GO   TO    A    PfiOCESSIHG    HOaTXIB^ 

I?    HEX?.  STOP  (BESSAGE)     =    DBSTi:i  ATIOM  (SESS  AGE) 

SCHEDaLE    A    COaPLZIED.  TBI?    GIVEN    HESSAGE    SEXE*- 
t  t  

17    PRUT    >-    1 

PRIST    1    LINE    AS    FOLLOWS 
AND    STOPS 
PEGAHDLESS 
f  f 

'•i2(2    I?    ?KT    IS    TO    COHTINUB.     ADDRESS    IT   TO    THE    NEXT    BP    NEIGHBOR    3ASBI^■ 

'  '  ii      ON    THE    NODE,    GROUP    OS    PAMILZ    ID   OF    THE    DESTIHAIION    AS    APPHOPaiAIB;;^ 

•  t 

ELSE 

LET    RELATER  (HBSSIGE)     =    THIS.SODB- 

LET    PS.  GP  (MESSAGE)     =    0 

LET    ?G    =    0 

IP    ?A.riLT     (THIS.rrODE)     NE   FiaiLT    (DESTIMATIOH    (HESSAGEJtt 

LET    :G    =    PAHILI    (DESTINATION     (HESSAGE)  1 

LET    5?. OBJ    =    ?G 

LET    ?1.G?     (MESSAGE)     =    FS 

GO    ASGN.NEXT.SrOP 
ELSE 
I?    GROD?     (THIS.  NODE)      NE    GECtJP     (OESTINATIOU    (HESSAGE)) 

LET    ~G    =    GRODP     (DESTINATION       HHSSAG2)  ) 

LET    5P.0HJ    =    FG 

LET    Fr-.G?     (MESSAGE)     =    FG^ 

GO    ASGN.NEXT.SIOP 
ELSE  • 

LET    EP.OSJ    =   DBSTINATIOH     (aESSACB^- 

•  ASGN.NEXT.SIOP* 
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LET    NEXT.  STOP  (SESSAG2)     =    BEST.  PATH     (THIS.  NODE,    BP.0BJ,1) 
LET    NODES. HOPPED  (MESSAGE)     =    tlODES.  HOPPED  (flESSAGZ)     ♦    1 
I  I 

••<«    SCHSDOLE    A    PROCESSING   COHPLETION   TIME    tfHEN    THE    PKT    tfILL   BE    REIDX 
'*ee       FOR    HETRANSaiSSION. 
I  I 

SCHEDOLS    A    CON. PACKET. MESSAGE    GIVEN    MESSAGE    IN    PHOCESSIHG.TIflE   OHIIS 

"EGAHDLESS 
t  I 

'•«<    GO    TO    THE    QOEaS    OP    THE    NODE    WHICH  RELATED    THE    ABOVE    PKT.       1?   HSPTr 

••^(S       DEFINE    THE    LINK    AS.  IDLE:     IF    NOT,  PLACE    THE    MEXT    PKT    ON    TH2    LIMi 

'•««:       AND    ADJUST   THE    QUEOS    INFORMATION  BY    CHEATING    A    HZ'd    PACK. 
I  t 

FOR    EACH    MESSAGE    IN    QOEOE (PAST. NODE)     WITH    N EXT. STOP (MESSAGE) =THIS. NOOB, 
FIND    THE    FIRST    CASE 
IF    NONE 

LET    LNK. MONITOR  (    PAST.  NODE,    THIS.  NODE,     1)     »    IDLE. 
ELSE 

REMOVE    MESSAGE    FROM    QUEO S  (PAST . NODE) 

LET    LNK.MON'ITOR  (PAST.  NODE,    THIS. NODE.    2)     « 

LNK.MONITOa <PAST.NODE,    THIS. NODE,     2)     -     1 
CREATE    A    PACK 

LET    NDHBER{PACK)     =    LNK. MONITOR     (PAST. NODE,    THIS. NODE,    21 
LET    ENTRY. TIME  (PACK)^    =    TIME.  V 
LET    PAC.HEIGHBOR(PACK)     =    THIS. NODE 
FILE    PACK    I^I    TIME. QUSOE  (PAST.  NODE) 
IF    NODES. HOPPED(MESSAGE)     =    0 

LET    RELEASE.  TIME     (MESSAGE)     »    TIME.f- 

REGARDLESS 
I  t 

•'««    SCHEDOLE   THE    ARRIVAL    OP    THE    PKT    JOST    RELEASED    FEOH    THE    QOEOE^ 
t  I 

SCHEDOLE    AN    ARIVE. PACKET    GIVES    MESSAGE    IN    PKT. XMN. TIME   aHITS" 
I  t 

IF    PENT    >=    1 

PRINT    1    LINE    WITH   TRANS.  NOHBSR  (MESSAGE)  ,     PACK.  NUMBER  (MESSAGE)  , 
RSLAYER  fMZSSAGE)  ,    NEXT.  STOP  (MESS  AGZ)  ,    FM.GPf  MESS  AGE)  .    DESTIHATIOff- 
(MESSAGE)  ,riME.  V,    LNK-  aONITOS  (  PAST  .  NOD  E,    IHIS.i^CiDE.     2)     AS    FOLLOWS 
.*ft*«<*'/*ft    LEAVES    »*    THRU    «»*    FOR    *»*  (**)    AT    ««»».•«»**«»    SEC     (F20M    Q)     QU*      ***=^ 

PEGARDLESS 
I  I 

REGARDLESS 
RETURN 

SND  • 'OP  AEIV2. PACKET 

«  I  — . 

I  I 

••««:    TJ!IS    ROUTINE    CONTINUES    THE    PACKET    ON    IT    BEST    PATH    APTEfi    PaOCESSIHC. 
''<tt       IF    THE    LINK    IS    IDLE,    OR    PLACES    IT    IN    A    QUEOE^ 

EVENT    CON. PACKET. USSSAGE    GIVEN    IDENT . MESSAGE. NOMBEa 
LET    "ESSAGE    =    IDENT.  .1  ESSA  GE.  NUMBER 
LET   THIS. NODE    =    3ELAYER     (MESSAGE) 

'•««    IF    LINK    IS    AVAILABLE,    SEND    OUT    PKT.       LIST    LINK    AS    3(JSr» 


"'schedule    AN    AfilVE. PACKET' GIVE 
I  f 

IF    PRNT    >=    1 


LNK. MONITOR     (    THIS. NODE,    NEXT.  STOP  (MESSAGE)  .     1)     =    IDLE 
... jj    MESSAGE    IN    PKT.ZMN.IIME    USITS 

PACK. NUMBER (MESSAGE)  ^ 

GP  (MESSAGE)  , 


r*.**i.-/rt*.  LEAVES  **  THRO  «*  FOR  »»(»•)  AT  **.«*•*••  SEC.  NO  WAIT— 

REGARDLESS 
f  I 

LET  LNK.MONITOR  (THIS.  NODE,  NEXT.  STOP  (MESS  AGE)  ,  1)  =  BOSr 

ELSE 
I  t 


««  If  LINK  WAS  3U5r,  PJ 
««   QUEUE  INFORMATION. 

FILE  MESSAGE  IN  QUEUE  (THIS.  NODE) 
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LSr    LNK.HONITOR     (THIS. MODE,     NEXT. STOP  (HESSAGE) ,2)     ■ 
LNfr.tlONITOR     (THIS.  NODE,    NEXT.  STOP  (MESSAGE)  .     2)     ♦    1 
IF    LNK.  MONITOR     (THIS.  NODE,     NEXT.  STOP  (MESS AGE)  .    2)     > 
LKK. MONITOR     (THIS.  NODE,    NEXT. STOP  (HESS  AG  E»  .     3) 
LET    LNK. MONITOR    jTHIS.NODE,     NEXT .  STOP  fMESS  AGE)  ,     3)     « 
LNK. MONITOR     (THIS. NODE,    N EXT. STOP (MESSAGE)  ,    2) 
REGARDLESS 
C3EATE    A    PACK 


LET    NUMBER  (PACK)     =    LMK.  MONTTOR     (THIS.  BODE,     NEXT. STOP  (HSSSiGE)  ,    2) 

LET    ENTRY. TIHE(PACK)     =    TIME./ 

LET    PAC.NEIGHBOR (PACK)     =    NEXT. STOP (MESSAGE) 


LET    ENTRY. flHE(PACK)     =    TIME./ 
LET    PAC.NEIGHBOR (PACK)     =    NEXT 
FILE    PACK    IN    TIMB.QOEOS     (THIS. NODE) 


IF  PPNT  >=  1 

PRINT  1  LINE  WITH  TR AHS . NOMBEP  (MES SAGE)  ,  PACK. NDMBEH (MESS  AGE)  , 

THIS.  NODE,  NEXT. STOP  fMESSAGS)  ,  TIME./,  LNK  .  MOMITOH  (T  HIS.  NODBr 

NEXT.  STOP  (MESSAGE)  ,  2)  AS  EULLOHS 
»>r*^a/a*  ENTERS  QO  IN  **  FOR  **  AT  **.♦♦•*♦*  SEC  QO  =   ••• 
REGARDLESS 

REGARDLESS 

RETURN 

END    "OF    COR. PICKET 

•  I 

•  t 

••««    THIS    ROOTINE    COLLECTS    STATISTICAL   DATl    SHEM   A    PKT    REACHES    ITS 
•'«:«      0ESTINATIO8. 
I  I 

EVENT    COMPLETED. TRIP    GI7EN    MES.NOH 

DEFINE    DEL. TIME    AS    A    REAL    VARIABLE 

LET    MESSAGE    =    MES.NOM 

LET  CNTR    =    NODES. HOPPED  (HESSAGE)     ♦I  '  - 

•'(£(t    PRINT    ALERT    IF    NODES    HOPPED    >=    TOTAL    NODES    IN    NETHOBK. 
t  f 

IF     (CNTR    >=    N.NODE    AND    MSG. HLT    =    0) 

PRINT    1    LINE    AS    FOLLOWS 

PR03LSM    —    MORE    HOPS    THAN    NODES 

LET    MSG. HLT    =    1 

REGARDLESS 
It 

'*te    INCREMENT   CODNTER    FOR    TOTAL    NODES    HOPPED    FOB    THIS    PKT    AND    SOH    NET 

''it      TIME    FOR    GIVEN     NUMBER    OF    HOPS. 
I  t 

LET    HOP.COaMT     (CNTR,     PACKET)     =    HOP. COON?     {CNTR,    PACKET)     ♦    1  -~- 

LST   DEL. TIME    =    TIME. 7    -    RELEASE. TIMS     (MESSAGE) 

LET    CLOCK. DATA    (CNTR,     1)     =    CLOCK. DATA     (CNTR,     1    )♦    DEL. TIME 

'•«:«    NOTE    IF    THIS    TRANSIT    TIME    IS    A    NEW    MAX    FOB   THIS    NOMBER    OP    HOPS. 


IF    DEL. TIME    >    CLOCK.  DATA     (CNTH  ,    2) 

LET   CLOCK. DATA     (CNTR,     2)     =    DEL.TiaE 


REGARDLESS 
I  I 

••(£«    INCREMENT    TRACER    ARRAY    WHICH    KEEPS    THE    NOMBER    OF    PKTS    GENERATED 
'•«(S       AND    THE    NUMBER    REACHING    THEIR    DESTINATION. 
I  I 

LET   TRACER     {TRANS  .  NOMBER  (MESS  AGE)  ,    2)=    TRACES  (TRANS.  NOMBER  (MESSAGE)  ,  2)  ♦I 

DESTPOY    MESSAGE    CALLED    MtS. NUB 

RETURN 

END    "OF    COMPLETED. TRIP 

I  I 

I  I 

•'«:«  THIS  ROOTINE  IDENTIFIES  A  SET  OF  THE  30SIEST  LINKS  OVER  THE  FIRST 

•'(t(£   HALF  OF  THE  SIMULATION  SO  THE  LINKS  CAN  BE  SAMPLED  DURING  THE 

''it      SECOND  HAL?  OP  THE  TEST. 

f  « 

EVENT    QO. SAMPLER 
f  f 

PRINT    1    LINE    AS    FOLLOWS 
MID    POIHT 
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••««    ID   THE    LARGEST    QUEOE    SIZE    IH    THE   FIRST    HALF   OF    THE    SIflOLATIO!!. 
i  • 

LET    I  »    1 

FOR    P    =    1    TO    H.HODB,    DO 
FOP    T    =    1    TO    M.NODE,     do 
IF    HAI    <    LN 

L2T    MAX 
REGARDLESS 
LOOP 
LOOP 


)    M.NODE,     DO 
INK. MONITOR     (?,T,3) 
=    LNK.aONITOH    (P,T,3) 


^tt    sap. LINKS    IS    AM    INPOT    VARIABLE    LISTING    THE   NOMBER    OF    LINKS    TO    SB 

*  tt      SASPLSD    FOR    QOSOE    SIZE. 

^tt    SSP.SST    IS    AN    ARRAY    CF    NODE    PAIRS    FOB    THE    "SMP. LINKS"    BOSIEST 

^tt      LINKS    OVER    THE    FIRST    HALF    OF    THE    SlflOLATION, 

t 

FILL. SHP. SET* 
FOR    F    =    1    TO    N.NODB,    DO 
FOR    T    =    1    TO    N.MODE,    DO 

IF    LSK. MONITOR     (F,T,3)     -    SAX 
LET    SNP.Sirri,  1)     =    P 

LET    SHP.SET(I»2)     =    T  ■  - 

IF    I    =    SMP.LIHKS 

GO  -BEGIN. SAflPLISG 
ELSE 

LET    I    =    1*1 
GO    HOP.NEH.SAI 
ELSE 
IF   N2».  MAX    <    LUX.  MONITOR  (F,T,  3)     AND    LNK.flONITOE  (F ,  T,3)     <   SAX 

LEI    SEW.HAX    =    LNK.ilONITOR(F,T,iJ 
REGARDLESS 
•  HOP.aEI.flAX' 

LOOP 
LOOP 
LET    WAX   =    NES.HAX 

GO    FILL. sap. SET 
f  • 

••««    SCHEDULE    FIRST   SAMPLE   OP    ALL    LINKS    IN    SHP.SET 
t  I 

*•  BEGIN. SAMPLING* 

LET    TI.MZS    =    TI3E.LIMIT/(2.'«    REAL.  F  (NO.  OF.  SAMPLES)  ) 
SCHSDaiB    A    SAMPLE    IN     (EXPONENTIAL. F ( II. SEE,    3))     UNITS 
PETORN 
END    ••    OF   QO. SAMPLER  __^ 

««    THIS    R00TIN3    SAMPLES    THE    LINKS    IDENTIFIED    IN    QO. SAMPLER    »ITH   Al 
tt       EXPONENTIAL    SAMPLING    RATE. 

EVENT    SAMPLE 

it   COOBT    ACTOAL    SAMPLES    TAKEN. 
LET    SMP.CKTH    =    SHP.CNTB    ♦    1 

tt    INCREMENT    COUNTER    BASED    ON    QUEUE    SIZE. 

FOE    I    =    1    TO    SMP. LINKS,    DO    . 

LET   QO.PISTR     (LNK. -ONITOR  (SMP.SET  (1, 1 )  ,  SMP.  SETfl,  2)  ,     2)-t-1)    » 
QU.OISTR     (LNK.aONITOH(SSP.SET(I,T)  ,SMP.SST  (1,2)  ,    2)  ♦•  1)     ■»•    1 
LOOP 

'»«<    SCHEDULE    THE    NEXT    SAMPLE. 

••««    ri.aZR    IS    DEFINED    IN    2U. SAMPLER 

<  I 

SCHEDULE    A    SAMPLE    IN     (EXPON 3NTI AL . F ( TI. MER, 3) )     UNITS 

sETURN 

END    "OF    SAMPLE 

/^ 

//SIH006      DD    STSO0T=A 

//*-O.Sia006       DD       VOL=SER=MVS00a.UNIT  =  3350,DISP=SHB,DSN  =  S203a.R0H, 

//*    DC3=(EECFM=F3,LRECL=133,3LKSIZE=4123) 
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12 

12 

13 

13 

ia 
15 
16 
16 
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00. 


1000 

2 
6 
7 
7 
3 

3 
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5 

9 
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7 
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13 
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15 
12 
16 
13 
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19 
14 
15 
20 
17 
21 
22 


<-    NOflBER    OP   LITJKS 
<-    TRANSMIT    FACTOH; 
RECEIVE    FACTOR; 
GROUP    NUMBER; 
FAHILT    HUHBEB 

M 


<-  UPDATE  PERIOD 

<-  ?KT  PROCESSING  TISB 

<-  PKT  TRASS:iISSIO!l  TISB 

<-  TEST  DURATION 

<-  SESSION  INTSR7AL 

<-  WINDOW 

<-    %    INNER-GHOOP;    %    INNER    FAHILI 

<-    DIAGNOSTIC    PRINT    LEVEL 

<-    NUMBER    OF    LINrCS    TO    3AHPLE;     NOHBES    OF    SAMPLES    SACS 

<-    NUMBER    OF    LINKS 

<-    NODE    PAIRS    FOR    EACH    LIHK 
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?IL2:  D290 
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OUTPUT  EXAMPLE 


NCCS      TRANSMIT  RECEIVE  GRCUP  FAMILY 

NC.       FACTOR  FACTOR  (FGf'  it)  (PGM  ») 

1  l.COO  1.000  l(30j  1(34) 

2  1.000  l.nOO  1(30}  1(24) 

3  l.COO  l.COO  2(21)  1(34) 

4  1.000  1.000  2(31)  1(34) 

5  l.CCO  1.000  2(31)  1(34) 

6  l.CCO  1.000  1(30)  1(341 

7  1.000  1.000  1(30)  1(34) 

8  1.000  1.000  2(31)  1(34) 

9  l.COO  1.000  2(21)  1(34) 

10  l.OOC  1.000  2(31)  1(34) 

11  1.000  l.COO  1(30)  1(34) 

12  1.000  1.000  1(20)  1(34) 

13  1.000  1.000  1(30)  1(34) 

14  1.000  1.000  2(31)  1(34) 

15  1.000  1.000  2(31)  1(34) 

16  1.000  1.000  3(32)  2(35) 

17  l.CCG  1.000  2(32)  2(35) 

18  1.000  1.000  A(33)  2(25) 

19  1.000  1.000  4(33)  2(35) 

20  1.000  1.000  A(33)  2(35) 

21  1.000  1.000  3  32)  2(35) 

22  l.CCO  l.COO  3(321  2(35) 

23  1.000  1.000  4(33)  2(25) 

24  1.000  1.000  4(33)  2(35) 

25  1.000  1.000  4(33)  2(35) 

26  1.000  1.000  3(32)  2(35) 

27  1.000  1.000  3(32)  2(35) 

28  1.000  1.000  4(23)  2(35) 

29  1.000  1.000  4(33)  2(35) 

'JPCATE    PERICC    IS  .100000    SEC 

=^CCESSING    TIME    IN    EACH    NODE    FCR    ANY    PACKET    IS     .000100    SEC 

FiCKET    TRANSIT    TIME    BETSEEN  ANY    Tk«C    NCOES    IS    .050000    SEC 

'EST    3lJRATIC^     IS    500.0001)00  SEC.    TEST    LIMITED    TC    ';5000    TRAFFIC    SESSIONS. 

^EW    TRAFFIC     SESSICN5    ARE    STARTED    AT    AN  AVERAGE     INTERVAL    OF          .100000    SEC 

CrANNEL    VALUE    CALCOLATICN    WINDCw    IS  .5COO0O    SEC 

EACH    TRAFFIC    SESSION    VARIES  FRCf*       1    TC  21    PACKETS 

AT    LEAST       0.    ?    CF    TRAFFIC    IS    INNER    GPCUPf    ANOTHER      0.    i    IS     INNER    FAMILY. 
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- 
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— 
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L'PCATE    PEftlCC    IS         .100000    SEC 

PROCESSING    TIKE    IN    EACH    NCOE    FCP    ANY    PACKET    IS     .000100    SEC 

JACKET    TRANSIT    TIME    BETWEEN    ANY    TxC    NCDES    IS    .050000    SEC 

TEST    OURATIC^     IS    500.000000    SEC.    TEST    LIMITED    TC    95000    TRAFFIC    SESSIONS. 

'JEW    TRAFFIC    SESSIONS    ARE    STARTED    AT    AN    AVERAGE    INTERVAL    GF  .100000    SEC 

CHANNEL    VALUE    CALCULATICN    WINDCW     IS  .500000    SEC 

EACH    TRAFFIC     SESSION    VARIES    FRCV       1     TC    21    PACKETS 

AT    LEAST       0.     i    CF    TRAFFIC    IS    INNER    GRCUP,    ANOTHER       0.    %    IS     INNER    FAMILY. 


NODES 

NC. 

MEAN    TIME 

PEAK    TIHE 

IDEAL 

HOPPED 

PKTS 

PER    PKT 

TIME 

TIME 

1 

57e<; 

.050045 

.050244 

.050000 

2 

7475 

.14304'; 

1.400245 

.100100 

3 

8365 

.267307 

2.06625e 

.150200 

4 

7718 

.371o00 

2.439480 

.200300 

5 

6757 

.47323C 

2.466388 

.2  50400 

6 

5470 

.60016  9 

2.949175 

.3C0500 

7 

4253 

.716520 

4.290086 

.350600 

8 

3234 

.a3522E 

4.190083 

.400700 

9 

1974 

.994239 

4.094386 

.450800 

10 

1155 

1.  146388 

4.239901 

.500900 

11 

704 

1.276437 

3.966191 

.551000 

12 

372 

1.514461 

4.153350 

.601100 

.13 

1?1 

1.590849 

5.253336 

.651200 

14 

79 

1.771252 

2.439857 

.7C1300 

15 

24 

2.387163 

6.051393 

.751400 

16 

27 

2.272257 

2.954242 

.801500 

17 

8 

1.901922 

3.539663 

.351600 

18 

6 

2.303152 

3.253066 

.901700 

19 

6 

2.162179 

4.204535 

.951800 

20 

2 

1.829691 

2.367558 

1.0G1900 

25 

2 

1.994116 

2.502305 

1.252399 

MEAN    NUMBER    CF    NODES    HCPPEO    PER    PACKET    IS         4.6 


A    TOTAL    OF 
CF    THESE, 


^956    NEW    XMNS    WERE    STiRTEC    (TOTALING       53664    PACKETS     I. 
73    PACKETS    WERE    UNDELIVERED    WHEN    THE    TEST    WAS    ENDED. 


=0R    EACH    NEW    LPDATE,    AN    AVERAGE    CF       23.1    LINKS    WERE    USEC. 

LONGEST    eEST    PATH    AT    ANY    TIME    WAS       16    LINKS. 

CUEUE    LENGTH    DISTRIBUTION 
10    LINKS    WERE    SAMPLED 
1C30    SAMPLE!    /    LINK    WERE    TAKEN 
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MAXIMUM 

CUEUE 

LENGTHX 

FROM 

TC 

MAX 

1 

2 
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14 
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10 
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28 

21 
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163 


18  17  20 

18  22  19 

22  18  33 

18  24  21 

24  18  26 

18  19  27 

19  18  28 

19  20  22 

20  25  27 

25  20  31 

21  26  20 

26  21  19 

21  22  33 
ZZ  21  23 

22  26  16 

26  22  23 

22  23  20 

23  22  20 
23  27  20 

27  23  18 
23  2  8  20 

28  23  29 

23  24  22 

24  22  20 
24  29  18 

29  24.  35 

24  25  24 

25  24  21 

25  29  20 
29  25  31 

26  27  19 

27  26  37 

27  28  20 

28  27  19 

28  29  34 

29  28  20 


.   Q-SIZE   -    S4HPLE    DENSITY 


0 

9613 

1 

119 

2 

73 

3 

58 

4 

34 

5 

60 

6 

45 

7 

49 

8 

22 

9 

26 

10 

25 

.1 

15 

61 

4 

21 

13 

5 

17 

6 

13 

a 

c 

9 

a 

20 

3 

AVERAGE  G 

LE^GTh  = 

.435 

STANCARC    -EVIATICN    =       2.0461 

LNLSUAL    DELAYS    FOR    PACKETS    NOT    OELIVEREO    CESCRIfiEO    BELOW 
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